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Preface 


This textbook is written for an introductory, or beginning, course in 
differential equations. It is more concise than most textbooks at this level. 
The reason is that most books are encyclopedic, and this enables them 
to also be used in more advanced courses. The approach taken here is to 
concentrate on the intended audience, and leave the additional material to 
textbooks written explicitly for the more advanced, or specialized, courses 
(and there are some very good ones available). It should also be pointed 
out that the greater length means that they are more expensive. 

One of the principal objectives of the text is fairly simple, and it 
is, given a differential equation, find the solution. Most of the text is 
dedicated to doing exactly this. The reason there is more than one chapter 
is that the way you solve the equation depends on what type of equation 
it is. A second important objective is to be able to determine the basic 
geometrical properties of the solution, and to be able to do this from the 
differential equation. This is important because real-world problems often 
involve equations that are difficult to solve, or you can solve them but the 
formula for the solution is complicated. In such cases, to be able to infer 
the basic properties of the solution directly from the differential equation 
is invaluable. If you want an example of what this means, read Section 
2.4. 

There are students, even very good ones, who do not read a lot of 
what is written in a mathematics textbook. If you are one of them, here 
are some tips. First, any text that is in bold font, make sure you read 
what it says. As a second tip, the table below is a listing of the 10 most 
often used words or phrases in the text related to differential equations. 
Given that there are only about 230 pages of text, these words are used 
a lot. Make sure, when the word or phrase is first used, that you know 
what it means. 

The prerequisites for this text vary with the chapter. The basic re- 
quirement is calculus, and it is essential that this includes integration 
rules such as integration by parts and partial fractions. The material re- 
quiring the calculus of vector-valued functions is in Chapters 4 and 5, and 
at the end of Chapter 6. These chapters also require an understanding 
of a few of the elementary properties of matrices, and a short summary 


vi 


Preface 


Word or Expression Used 
solution(s) 840 
differential equation(s) 270 
linear /nonlinear 220 
steady state 220 
stable/unstable/stability 205 
eigenvalue(s) 160 
general solution 185 
homogeneous /inhomogeneous 110 
initial value problem/TVP 105 
initial condition(s) 105 


Table 1. Approrimate number of times the word, or phrase, is used in this textbook. 


of what you need to know is given in Appendix A. It is not necessary to 
have taken a course in matrix algebra. However, there is a fundamental 
connection between differential equations and linear algebra, and this con- 
nection is used throughout this textbook. The material is written so it is 
self-contained, so a previous course in linear algebra is not necessary. You 
will see comments, such as “if you recall from linear algebra,” which are 
used to indicate where the connections are, but the material required for 
differential equations is then written out explicitly. Occasionally there 
are facts, or results, from linear algebra that are needed and they are 
stated without proof. This is also done with other topics, and in such 
cases references are often given where you can find out more about the 
subject. 

A computer, or computer software, are not required anywhere in this 
text. There are, however, a small number of exercises that require you to 
evaluate a mathematical expression using a calculator. 

There is a web-page for the text, and it is reachable via the author’s 
GitHub repository (github.com/HolmesRPI/IntroDiffEqs). It includes 
plots needed for some of the exercises, videos, and, assuming there are 
any, a listing of the typos. 

I would like to thank Peter Kramer for numerous, very useful, sugges- 
tions on how to improve the text. Also, as usual, I would like to thank 
those who developed and have maintained TeXShop, a free and very good 
TeX previewer. 


Mark H. Holmes 

Department of Mathematical Sciences 
Rensselaer Polytechnic Institute 
June, 2028 


Chapter 1 


Introduction 


We begin with a question: why are most students who are majoring 
in engineering or science required to take an entire course dedicated to 
something called differential equations? 


We'll start to answer this by giving a couple of examples where they 
arise, and this will also provide an opportunity to introduce some of the 
terminology used in the subject. 


Example 1: Rate Laws 


These describe the fluctuations, or changes, in something. The something 
in this case could be the concentration of a chemical, a population of 
animals, or perhaps the temperature of an object. As a simple example, 
a radioactive isotope is unstable, and will decay by emitting a particle, 
transforming into another isotope. The assumption usually used to model 
such situations is that the rate of decrease in the amount of radioactive 
isotope is proportional to the amount currently present. To translate this 
into mathematical terms, let N(t) designate the amount of the radioactive 
material present at time t. In this case we obtain the rate equation 


dN 


ae = —kN, for 0 < t, (1.1) 


where k is a positive constant. This is a differential equation for N. 
Usually one knows the amount No of the isotope at the beginning, which 
gives us the requirement that 


N(0) = No. (1.2) 
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This is known as an initial condition. Together, (1.1) and (1.2) form 
what is called an initial value problem (IVP). 


Example 2: Mechanics 


One of the biggest generators of differential equations is Newton’s second 
law, which states that F = ma. Any situation, electrical, mechanical or 
otherwise, involving non-static forces will almost inevitability result in 
having to solve a differential equation. To illustrate, consider the simple 
case of dropping an object off a building. If x(t) is the distance of the 
object from the ground, then its velocity is v = 2’(t), and its acceleration 
is a = v(t). If the forces on the object are gravity Fy = —mg, and air 
resistance F;, = —cv, then F = F, + F;.. Together, these expressions result 
in the following differential equation for x(t): 


m =-mg—c—. EH (1.3) 


The differential equations in (1.1) and (1.3) have a few things in com- 
mon, such as there is one independent variable, t, and one dependent vari- 
able, N and x. There are also differences, and an example is that (1.3) 
involves the second derivative and (1.1) only involves the first derivative. 
It is important to be able to recognize these differences as they are often 
used in this textbook to determine how to solve the problem. 


1.1 » Terminology for Differential Equations 


Problems involving differential equations can involve a single equation, 
or several equations. They can also have one independent variable, or 
several. There are other differences, and to help illustrate some of the 
possibilities we will use the following examples. 


d? d 0 O 
Example 1: a _ 2F + 4ty = 0 Example 2: HT — 2 =u? 
d 
Example 3: aa utetl 
a +v 
—=>-U 
dt 


Dependent variable(s): This is the variable(s) being solved for. 


Example 1: y Example 2: u Example 3: u and v 
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Independent variable(s): These are usually time (t) and/or space (). 


Example 1: t Example 2: x and t Example 3: t 


Order: The order of the highest derivative in the equation (or equations). 


Example 1: second-order Example 2: first-order 
Example 3: first-order 


Linear or Nonlinear: A differential equation is linear if it is a linear 
expression of the dependent variable and its derivatives, otherwise 
it is nonlinear. 


Example 1: linear Example 2: nonlinear (because of the u?) 
Example 3: linear 


ODE or PDE: If there is one independent variable, then it is an ordi- 
nary differential equation (ODE). If there is more than one inde- 
pendent variable, then it is a partial differential equation (PDE). 


Example 1: ODE Example 2: PDE Example 3: ODEs 


Homogeneous or Inhomogeneous: A linear differential equation is 
homogeneous if the identically zero function is a solution. Oth- 
erwise, it is inhomogeneous. 

Example 1: homogeneous since y = 0 is a solution 
Example 2: inapplicable since the equation is not linear 


Example 3: inhomogeneous since u = 0 and v = 0 is not a solution 


1.2 » Solutions and Non-Solutions of Differential Equations 


One of the central questions of this textbook is how to find the solution 
of a differential equation. The examples below are about the reverse 
situation, where a function is given and the question is whether it is a 
solution of a particular differential equation. 


—2t 


Example 1: Show that y = te~*’ is a solution of y’ = —2y + e~6. 


Answer: Since 
y =e % — Ite-™ = (1 — Ite, 
aye = oe hea Oe es, 


it follows that y/ = —2y + e~¢ (i.e., y is a solution). 
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rt 


Example 2: For what value(s) of r and c, if any, is y = ce” a solution 


of the IVP: y’ + y = 0, where y(0) = 3? 


Answer: Since y’ = rce™, then from the differential equation we 
require that rce™’+ce™ = 0. This can be written as (r+ 1)ce™ = 0. 
Given that e” is never zero, we conclude that either c = 0 or else 
r = —1. From the initial condition y(0) = 3, we need c = 3, and so 
this means that r=—1. 4H 


rt 


Example 3: For what value(s) of r, if any, is y = e” a solution of the 


equation y” — y’ — 6y = 0? 


Answer: Since y’ = re”, and y” = r?e™, then from the differential 
equation we require chat (r?—r— “6)ett = 0. Given that e” is never 
zero, we conclude that r?—r—6 = 0. Solving this, we get that r = 3 
and r = —2 are the only values for which y = e™ is a solution. ll 


rt 


Example 4: For what value(s) of r and c, if any, is y = e”™ a solution of 


y! = 2y°? 


Answer: Since y’ = re”, then from the differential equation we 
require that re™ = 2e?"'. Given that e” is never zero, we need 
r = 2e?"'. The left hand side is constant. The only way to have 
the right hand side a constant is to take r = 0. In this case, the 
differential equation becomes 0 = 2. This is not possible, and so the 
answer is that no values result in a solution. MH 


Exercises 


1. Show that the given function y(t) is a solution of the given differential 
equation. 


a) y=e*—1, yf = 2y4+2 e) y=e+1, y” + 2y' —3y=-3 
bgate. a ae fhy=ra, ty =0 

c) y=cos(3t), y” = —9y g) y=tan(gt+1), 3y/=1+y? 
d) y=e*, y’+y-—12y=0 h) y=In(1+#?), x = 2te¥ 


rt 


2. For what value(s) of r, if any, is y = e” a solution of the differential 


equation? 

a) y= _ f) y —4y' + 4y =0 
b) 3y! = g) y ty tyse* 
st eee h) y” —3y’+y=1 
d) y+ 4y’ =0 i) yf = —2y° 

e) 2y” + 5y' — 3y =0 )e=y_y 


Exercises 


3. For what value of r and c is y = ce” a solution of the IVP? 


a) y’=-2y, y(0)=1 d) y’-y=0, y(0)=-1 
b) y+y=0, y(0)=-1 e) 5y =-2y, y(0)=-7 
c) 8y¥-—y=0, y(0)=3 f) y+4y=0, y(0)=3 


4. The following are linear and homogeneous first-order differential equa- 


tions. The given function y(t) is a solution, and you are to show that 
y = cy; is a solution for any value of the constant c. 


a) «yi =2y, -gr=e" c) y—-4y=0, yw=e” 


b) yty=0, yw=e* d) 3y¥=y, w=e/s 


. The following are linear and homogeneous second-order differential 


equations. The given functions y;(t) and yo(t) are solutions, and you 
are to show that y = c1y1 + coy2 is a solution for any value of the 
constants c, and co. 


a) y” — 3y' + 2y = 0, c) y +4 = 0, 
yHe. He" vise. gee 
b) y” —y' —2y =0, d) y’ + 2y’ + 5y =0, 


2t 


=t 
Yi=rev, Y2a-e 


y1 =e‘ cos(2t) 
yo = e ' sin(2t) 


Important Conclusion: Problems 4 and 5 are demonstrations of the 
fact that if yi(t) and yo(t) are solutions of a linear and homogeneous 
differential equation, then c1y1(t) + cey2(t) is a solution of the equation 
for any value of cy and co. This is known as the principle of super- 
position, and it holds for all linear homogeneous differential equations 
(ODEs or PDEs). Moreover, as demonstrated in the following exercise, 
this does not (usually) hold for a nonlinear differential equation. 


. Both yi(t) and yo(t) are solutions of the given nonlinear differential 


equation. Show that (i) y = ciyi(t) is not a solution unless c, = 1, 
and (ii) y = ciy1 + c2y2 is not a solution if c; and c2 are both nonzero. 


a) y =t/(1+y), b) y =VJI+y, 
yi =—l+t, y=-l-t y= qe tt, yo = Gt? +2643 


. Fill out the table on the next page. Assume that any constants in the 


equation(s) are nonzero. Also, in the last column, the answer Inap- 
plicable (IA) is possible. Reference for Schrédinger’s equation image: 
Eigler [2020]. 
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Chapter 2 


First-Order Equations 


This chapter concerns solving differential equations of the form 


Y — Fy), 
where f(t,y) and the partial derivative f,(t,y) are continuous. There 
are no known analytical methods that can solve the general version of 
this problem. Consequently, assumptions have to be made on f(t, y) to 
be able to derive a solution. The two more useful assumptions are that 
f(t, y) is separable and the other is that it is linear. Both are considered 
in this chapter. The fact is, however, that for many real world problems 
it is not possible to solve the differential equation by hand. Consequently, 
the ability to determine the properties of the solution, without actually 
solving the problem, becomes essential. What this entails is introduced 
in Section 2.4. 


2.1 » Separable Equations 
To introduce this method we begin by considering the differential equation 
dy _ 
dt 
We are going to treat the derivative as if it were a fraction, and rewrite 
the above equation as 


By”. (2.1) 


dy 


So, the variables have been separated in the sense that all of the y terms 


are on the left hand side, and the t terms are on the right. We now 
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integrate both sides, which gives 


dy 


Carrying out the integrations, and including the usual integration con- 
stant, we have 


1 
—-=3t+c. 2.3 
; (2.3) 
Solving this for y, we obtain the solution 
1 
=— ; 2A 
oe 3t+e eo 


The last step is to check on whether the separation of variables step might 
involve dividing by zero. This happens for (2.2) when y = 0. Moreover, 
the constant function y = 0 is a solution of (2.1), and it is not included 
n (2.4). Consequently, another solution of the differential equation is 


y=0. (2.5) 


The method used to solve (2.1) is rather simple, but it contains the 
questionable step of splitting the derivative to obtain (2.2). To explain 
why this is possible, note that (2.1) can be written as y > te = 3. Using 
the chain rule, this can be written as —Zy7) = 3. Integrating this 
equation yields (2.3). So, the splitting the derivative step is effectively a 


compact version of using the chain rule. 


2.1.1 » General Version 


To explain how the method can be used for other problems, suppose the 
differential equation to solve is 


oY = f(t,y). (2.6) 


The method requires that it is possible to find a factorization of the form 
f(t,y) = F(t)G(y). This means that it is possible to write the differential 
equation as 


dy 
& = F()G(y). (2.7) 
Separating variables gives 
dy 
—* — F(t)dt, 
ay) 7 


and integrating we get 


ae ae / F(t)dt. (2.8) 
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In theory, you carry out the above integrations, and then solve for y. 
How difficult this might be depends on how complicated the y integral 
is, and the examples that follow illustrate some of the complications that 
can arise. It is also important to note that the above method requires 
that G(y) 4 0. Consequently, in addition to the solutions that come from 
(2.8), you must include as solutions any constant that satisfies G(y) = 0. 


Example 1: Find all solutions, obtained using separation of variables, 


of 4y/ = —y?. 


Answer: Since f(t,y) = —jy®, we can take F(t) = | and G(y) = 


—y?. So, (2.8) becomes 
dy 1 


Integrating gives us 


: : t+ 
—_ = Cc 
Qy2 4 : 
which is rewritten as 5 
y= : 
t+ 4e 


From this we obtain the two solutions 


ae +. (2.9) 


To check on the G(y) = 0 solutions, solving G(y) = 0 gives y = 0. 
This constant function is not included in the above expressions for 
y, so it is a third solution of the equation. 


Example 2: Find the solution of the IVP: 4y’ = —y?, where y(0) = —3. 


Answer: The three solutions of the differential equation were de- 
rived in the previous example. Because the initial condition requires 
the solution to be negative, the solution we need is 


Setting y = —3 and t = 0 in this equation gives 3 = 1/V2c, which 
means that c = 1/18. Therefore, the solution is 
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Example 3: Is y/ + y =t a separable equation? 


Answer: No. For this equation, f(t, y) = t—y, and it is not possible 
to factor this as f(t,y) = F(t)G(y). How to solve this equation is 
explained in the next section. 


d 
Example 4: Solve 77 = = where w(0) = —2. 
Answer: In this problem the independent variable is x and the 
dependent variable is w. Separating variables, so (1+ w)dw = xdz, 


and then integrating gives 


fo +w)dw = [vee 


Carrying out the integrations we get that 


1 1 
w+ —w? = <2? +6. 


2 2 
To satisfy the initial condition, substitute w = —2 and x = 0 into 
the above equation, from which we get that c = 0. This leaves 
w+ su = 5x", or equivalently, w? + 2w — «2? = 0. This is a 


quadratic equation in w, and solving it we get the two solutions 


w=-ltvVJl42?. 


The initial condition is needed to determine which sign to use, and 
since w(0) = —2 then we need the minus sign. Therefore, the solu- 
tion of the IVP isw=-1-—Vl+2?. 


¥ 
Example 5: Solve y’ = —-—*—, where y(0) = 1. 
Pp y coy y(0) 


Answer: Separating variables yields 


1 
aU ay ae 


Since (14+ y)/y = 1/y4+ 1, and y(0) > 0, then integrating we get 
that 
ytIny=-tt+e. 


It is not possible to solve this for y as in the previous examples, 
without resorting to more advanced mathematical methods. For 
this reason, this is an example of what is called an implicit solu- 
tion, and they are very common when solving nonlinear differential 
equations. Even so, it is still possible to find c from the initial con- 
dition. Substituting y = 1 and t = 0 into the above equation we get 


2.1. Separable Equations 11 


that c= 1. Therefore, the solution of the IVP is defined implicitly 
through the equation 


y+Iny=-t+1. Of (2.10) 


A few comments need to be made about separation of variables before 
ending this section. 


Integration Constant: The integration constant plays an essential role 
in the solution of a differential equation. It is useful to be aware that 
there are different ways you can write it. As an example, instead of 
(2.9), you can write the solution as 


__ fe 
TS pie 


where ¢ = 4c. Similarly, if the solution is found to be 


_ 3t-—2c+4 
aa t+2c-—4’ 


you can write it as 
3t—¢é 
= ; 2.11 
Tae (2.11) 


where ¢ = 2c— 4. For both of these examples, the solution contains 
one undetermined constant, just as in the original version of each 
solution. It should also be mentioned that this simplification is often 
used when giving the answers to the exercises. Moreover, instead of 
(2.11), the answer will likely be written as 


- She 
o> t+ec- 


Linear or Nonlinear: The method works on linear and nonlinear first- 
order differential equations. However, it does not work on every 
linear or nonlinear equation. 


Non-uniqueness of Factorization: The factorization f(t, y) = F(t)G(y) 
is not unique. For example, for f(t,y) = y + ty you can take 
F(t) = 1+t and G(y) = y. You can also take F(t) = 5(1+ 1?) 
and G(y) = 2y. It makes no difference which one you use, it is just 
required that f(t,y) = F(t)G(y). Any such factorization will lead, 
eventually, to the same, or an equivalent, solution of the differential 
equation. 
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Existence and Uniqueness: When solving an IVP there is always the 
question of whether there is a solution (existence), or whether there 
is more than one solution (uniqueness). As it turns out, there are 
problems that have no solution (see Exercise 6(a)), or have multiple 


solutions (see Exercise 6(b)). 


It is possible to guarantee a unique 


solution by augmenting the continuity assumption we have made 
on f(t,y) and fy(t,y). The formal statement of the requirements, 
and the conclusions, are contained in what is known as the Picard- 
Lindelof theorem. This is beyond the purview of this text, but it 
can be found in most upper-division textbooks on ODEs. 


Exercises 


1. Find all of the solutions, obtained using separation of variables, of the 


given differential equation. 


a) y =—3y4 f) (1+t)y =e — k) 2y'=y? -6y+9 
b) yf =yre™ Se l) 8y =y? +1 

c) y+ y’sint =0 h) yf = —29 m) y/ +te¥ =te¥ 
d) io 3) i) of +1 + 3y) ye 
e)yY=—(2+the’ jp y=yrt4yt+4 0) y =tlyt1/y) 


2. Find the solution of the IVP. 


a) yf = —3y?, y(0) =5 
b) y! =—2y?, y(0) =0 
c) I+t)y=3+y, y(0)=4 
d) (4+ e')y’ + ety? =0, y(0) = 
e) y =te¥, y(0)=-1 
) ¥=s u0)=0 


) y =1+cos(y), y(0) = 7/2 
oye? = by, 90) S41 

i) yte*#=1, y(0)=1 

)y =1(e%+e%), y(0) =0 
) 


y=vV1-y, y(0)=0 


Hint: y/ > 0 


3. Find the solution of the IVP. In these problems, the independent vari- 
able is not t and the dependent variable is not y. 


dq _ 3 = 
dp _ 3 _ 

c) ee h(0) = 2 
dt 

d) a =h?—3h, h(0) =2 
dx 


e) (te) 42? 0, z(0) =6 
f) oe =e | w(0) =0 

g) 041 =o?, (0) =2 

) 57 a n= 
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4. Find the solution of the IVP in implicit form. 


1 l+y 
Palo {Oye 5 1s 
a) y aes y(0) c) y jag 
3 dp eP 
b) y/ =——.,, (0) =-1 d) Pe 9 
be Saas OO) ) ag eee 
Ab J 
a 
3 
> 
0 
—L 0 L 


x-axis 


Figure 2.1. Cable hanging between two poles, as described in Exercise 5. 


5. A cable is hung between two poles as illustrated in Figure 2.1. The 


poles are located at « = —L and x = J, and each has height h. 
The curve y() minimizes the cable’s potential energy. From this, one 
obtains the equation 


dy 


2 
) , for ~-L<a< J, 
da. 


ass= 1+ ( 
z 


where a is a positive constant. Because of the symmetry in the prob- 

lem, y’(0) = 0. 

a) Letting w(x) = y’(x), rewrite the differential equation as a first- 
order equation involving w and w’. Also, what is w(0)? 

b) Solve the problem in part (a) for w. 

c) Integrate y'(x) = w(a), and use the condition y(L) = h, to deter- 
mine y(z). The solution you are finding is an example of what is 
called a catenary. 


. The following illustrate some of the complications that can arise when 


solving differential equations. 


a) Consider the IVP: ty’ = y+ 1, where y(0) = 1. Try solving this 
and show that there is no solution (at least when using separation 
of variables). 

b) Show that there are an infinite number of solutions of ty’ = y + 1, 
where y(0) = —1. 

c) Solve y/ = ie where y(0) = 1. Explain why there is no solution 
for t > 1. This is known as finite blowup. 
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2.2 » Integrating Factor 
The equation to be solved is 
y' + p(t)y = g(t). (2.12) 


What is important here is that this equation is linear, as well as first- 
order. Also, our earlier assumption that f(t, y) and the partial derivative 
fy(t,y) are continuous reduces to the assumption that p(t) and g(t) are 
continuous for t > 0. 

The solution will be derived using two formulas from calculus. The 
first is the product rule, which states that 


“() = w(t)y'() + (y(t). 213) 


The second is the Fundamental Theorem of Calculus, which states that if 


() = q(t), 
then : 
y= / q(s)ds +c. (2.14) 


The first step is the observation that the left hand side of (2.12) re- 
sembles the right hand side of (2.13). To make it so they are exactly the 
same we need to multiply the differential equation by p(t), which gives us 


py! + upy = ug. (2.15) 
What we need, to get this to work, is that 4 must be such that 
hl = py. (2.16) 
It will make the formula for the solution a bit simpler if we require 
y(O) = 1. (2.17) 


The differential equation (2.16) is separable, and one finds that the solu- 
tion that satisfies (2.17) is 


y(t) = efo P(r)ar, (2.18) 

With this choice for y, the differential equation for y in (2.15) can be 
written as d 

a tly) = Hg (2.19) 


From (2.14) we get that 


py = / (s)g(s)ds + ¢, 
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where c is the usual integration constant. The solution of (2.12) is there- 
fore 


i) = a] [ wlsdo(s)as +e]. (2.20) 


y(t) 


The function p(t), which is given in (2.18), is said to be an integrating 
factor for the original differential equation. 

There are two important special cases to mention. First, suppose that 
the problem has an initial condition, say y(0) = yo. Since (0) = 1, then 
from (2.20) the solution of the resulting IVP is 


ult) = | | weats)as + w]: (2.21) 


y(t) 


The second special case arises for the homogeneous equation y’+p(t)y = 0. 
Setting g = 0 in (2.20), gives us the solution 


y(t) = ce Jo Pr)ar (2.22) 
If y(0) = yo, then the resulting solution is 


y(t) = ye fo rar, (2.23) 


Example 1: Solve y/ + 3y = e”!. 


Answer: Since p = 3, then 


t t 
| p(r)dr =i od = St. 
0 0 
2t 


From (2.18), the integrating factor is pp = e®*. So, since g(t) = e”, 
then from (2.20), 


t t 
sae" | / ee ds + (| at | / e*ds + (| : 
0 0 


Carrying out the integration, 


t 


1 
y(t) - e738 Ea 


3t 


i ee 
= ge +ce, 


where €¢ = c—1/5 is an arbitrary constant. lH 
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Example 2: Solve 2y/ — ty = 6, where y(0) = 5. 


Answer: Since p = —t/2, then from (2.18), = e~’/4. Given that 
g = 3, then from (2.21) we have 


t 
y(t) =e /4 | f 3e~* Ads + 5. 
0 


The integral in the above expression can not be written in terms of 
elementary functions, and so that is the final answer. MH 


Example 3: Solve o — 4h = 2z, where h(0) = —1. 
Z 


Answer: In this problem the independent variable is z and the 
dependent variable is h. The formula for the solution can still be 
used, we just need to make the appropriate substitutions. Since 


p= —4, then 
| p(r)dr = —4dr = —4z. 
0 0 


From (2.18), the integrating factor is = e~ 4. So, since g(z) = 2z, 
then from (2.21), 


h(z) = e* | f 2se~ ds — 1 
0 


1 is 
= — (42 +1)- ae a 


2.2.1 » General and Particular Solutions 


We have shown that the solution of the linear differential equation 


y' + p(t)y = g(t), (2.24) 


He | i Seat c. (2.25) 


u(t) 
Any, and all, solutions of (2.24) are included in this formula, and for this 


reason (2.25) is said to be the general solution. 
A useful observation about (2.25) is that it can be written as 


y(t) = Yp(t) + yn(t), (2.26) 


where 


w(t) =f wlsdalsies (2.27) 
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me — fo (rar 

tit) = D =ce 0 : (2.28) 
The formulas for y, and y;, are not important here. What is important is 
that yp is a solution of the differential equation (2.24). It does not contain 
the arbitrary constant, and for this reason it is said to be a particular 
solution. In contrast, the function yp,(t), which contains an arbitrary 
constant, is a solution of the differential equation 


y + p(t)y = 0. (2.29) 


This is the homogeneous equation coming from (2.24). Consequently, 
yn(t) is said to be the general solution of the associated homoge- 
neous equation. 


Example 4: In Example 1 we found that the general solution is 
1 ot, = -3¢ 
y(t) = ne +ce", 


where ¢ is an arbitrary constant. In this case, a particular solution 
iS Yp = ze", and the general solution of the associated homogeneous 
equation is y, =¢e~*". 


The observation in the previous paragraph that the general solution 
can be written as the sum of a particular solution and the general solution 
of the associated homogeneous equation holds for all linear differential 
equations (not just those that are first-order). Because we are able to de- 
rive a formula for the solution, which is given in (2.25), this observation 
is not really needed to solve first-order linear differential equations. How- 
ever, for second-order equations, which will be studied in the next chapter, 
this observation serves a fundamental role in finding the solution. 


2.2.2 » Interesting But Tangentially Useful Topics 


The following topics are worth knowing about. However, you can skip this 
material, if you wish, as it is not required to solve any of the problems in 
this chapter. 


Method of Undetermined Coefficients 


Most first-order linear differential equations that arise in applications have 
constant coefficients, which means that they can be written as 


y' + ay = g(t), (2.30) 


where a is a constant. Examples are y’ + 3y = 5 and y/ — 2y = e*. It 
is likely that the Instructor for your course can solve these in their head, 
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and they simply write down the solution. You should not be impressed, 
thinking they are using (2.25) to do this. Rather, they are using the 
method of undetermined coefficients. This method is explained in Section 
3.7 for second-order equations, but it works on first-order equations as 
well. The reason it is easier is that it avoids having to integrate anything, 
and you therefore do not need to remember integration rules to find the 
solution. If you want to pursue this idea a bit more, after reading Section 
3.7, you should look at Exercise 5 on page 61. 


Connections with Linear Algebra 


For those who have taken a course in linear algebra, there is a connec- 
tion between that subject and linear differential equations that is worth 
knowing about. To explain, a central problem in linear algebra is to solve 
Ax =b, where A is am Xx n matrix. It’s possible to prove that if there 
is a solution of this equation, then it has the form x = x, + xp, where 
Xp is a particular solution and x, is the general solution of the associated 
homogeneous equation Ax = 0. This is basically the same statement we 
made for the solution of the linear differential equation (2.24). The key 
property these equations have in common is that they are both linear. A 
consequence of this is that the principle of superposition can be used (see 
page 5) when solving the associated homogeneous equation. We will make 
use of this fact in every chapter of this textbook, except for Chapter 5. 
This illustrates the beauty, and profundity, of mathematical abstraction. 
Namely, it is possible to make rather significant conclusions about the so- 
lution of an equation, irrespective of whether it is algebraic or differential, 
simply from the basic properties these equations have in common. 


Exercises 


1. Find the general solution of the given differential equation. 


a) y+ 3y=0 e) (3t + 2)y’ + 3y = sin(4t) +5 
b) y —2y=t f) 2+t)y+y=1 

c) 4y' -—y = 64 2t g) y —3y=14+Vvt 

d) y’ =—y+2e'-1 h) 2y'+y= 75 


2. Find the solution of the IVP. 
a) yi -y=4, y(0)=-1 d) 2y’=y+3e%-4, y 
b) y +4y = 24t, y(0) =0 e) (5+t)y+ty=—-l, y 
c) by +y=0, y(0) =2 f) 3y'+ty=—2, y(0)=0 
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. Find the solution of the IVP. In these problems, the independent vari- 


able is not t and the dependent variable is not y. 


dq 7 _ dz _ = 

a) 7 + 2g=4, q(0) =—1 d) qe 2(0) =0 
dp _ = dh ee = 

b) 7 + 4p =—8e, p(0) =0 e) (@+7)7 +h=—l, h(0) =2 
dw —s = dh = = 


. Find a particular solution, and the general solution to the associated 


homogeneous equation, of the following differential equations. 
a) y’ —2y=6 c) Ty’ —y=e%4+3 
b) y’ +y=8e% d) y/ +2ty=1 


. Find the value of yo so that the solution of the IVP is bounded as 


t > oo. 
a) y’—y=1+45cos(2t), where y(0) = yo 
b) y’ — 3y =sint + 3cost, where y(0) = yo 


. A Maxwell viscoelastic material is one for which the stress T(t) and 


the strain-rate r(t) satisfy 


dT 
LT ae =k} 


where 7 and « are positive constants. By solving this equation for T, 
and assuming Ty = T(0), show that 


t 
T = Toe! + = ih e8-O/Tr(s)ds. 
T JO 


. The Bernoulli equation is w’ = p(t)w + q(t)w”, which is nonlinear if 


n #0,1. What is significant is that it can be solved by making the 
substitution w = y!/C-"), which results in a linear equation for y(t). 
This was discovered by Leibniz, although it is not clear he was aware 
of the solution (2.20) for a linear equation [Parker, 2013]. 
a) If w’ = w — 5w?, where w(0) = 1, what IVP does y satisfy? 
b) Solve the IVP for y, and then transform back to determine the 
function w. 
c) One of Bernoulli’s brothers solved the Bernoulli equation by as- 
suming that w(t) = u(t)v(t), where wu satisfies u’ = pu, for 
u(0) = 1. Use this method to solve w’ = w — 5w?, where 
w(0) = 1. This approach is the precursor to what is now known 
as the method of variation of parameters. 
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2.3 » Modeling 


The principal objective of the examples to follow is to show how a dif- 
ferential equation is the mathematical consequence of the assumptions 
about a physical system. 


2.3.1 =» Mixing 


Typical mixing problems involve a continuously stirred tank, as illustrated 
in Figure 2.2. As an example, suppose that water, containing salt, is 
flowing into a well-stirred tank. At the same time, the mixture in the 
tank is flowing out. The goal is to determine how much salt is in the tank 
as a function of t. 


Figure 2.2. Schematic of a continuous stirred tank. 


The quantities of interest in this problem are: 


Q(t): This is the amount of salt in the tank at time t. If the volume of 
water in the tank is V, and c is the concentration of salt in the water, 
then Q =cV. 


Rin: This is the rate that salt is flowing into the tank. If the incoming 
volumetric flow rate is Fj,, and cjy is the concentration of salt in the 
incoming water, then Rin = Cin Fin. 


Rout: This is the rate that salt is flowing out of the tank. If the outgoing 
volumetric flow rate is Fouz, then Rout = cPout- 


If the initial amount of salt in the tank is Qo, then the resulting IVP for 
Q is: 
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Example 1 


Suppose that salt water, containing 1/2 lbs of salt per gal, is poured into 
a tank at 2 gal/min. Also, the water flows out of the tank at the same 
rate. If the tank starts out with 100 gal of water, with 10 lbs of salt per 
gal, find a formula for the total amount of salt in the tank. 


Setup 
inflow: Since Fj, = 2, and cy, = 1/2, then Rj, = 1. 


outflow: Since the mixture flows out at 2 gal/min, then the volume of 
water in the tank stays at 100 gal. Also, since Fo, = 2 and c = 
Q/100, then Row = 4Q. 


t = 0: Given that at the start there are 10 lbs of salt per gal, Q(0) = 1000. 


The resulting IVP for Q is: 


dQ 1 
ed ee (2.31) 
Q(0) = 1000. (2.32) 


Note that because of the way the variables have been defined, Q is mea- 
sured in pounds and ¢ is measured in minutes. 


Solution 


Using separation of variables, or the integrating factor solution (2.21), 
one finds that Q(t) = 50 + 950e7*/5°, 


Question: What is the eventual concentration of salt in the tank? 


Answer using solution: Since lim: Q(t) = 50, then the eventual con- 
centration is 50/V = 5 lbs/gal. 


Answer using physical reasoning: The concentration in the tank will even- 
tually be the same as the concentration for the incoming flow, and 
so the answer is 5 lbs/gal. 


Answer using math reasoning: It is possible to determine the eventual 
concentration directly from the differential equation, without know- 
ing the solution. How this is done is explained in Section 2.4 (also, 
see Exercise 6 in that section). 


Example 2 


Salt water, containing 3 lbs of salt per gal, flows into a 50 gal drum at 2 
gal/sec. If the drum initially contains 10 gal of pure water, find a formula 
for Q as a function of t. 
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Comments about this problem: There is no outflow, so the volume of 
water will increase. However, it’s a 50 gal drum, so eventually it will fill 
and start running over. When this occurs there is outflow, at a rate equal 
to the incoming rate. To account for this, the problem needs to be split 
into two phases, one where the volume is increasing, and the second when 
it is a constant. 


Solution 


Phase 1: In this case, Rin = 6, Rout = 0, and Q(0) = 0. The resulting 


IVP is 
dQ _ 
We =6 
Q(0) = 0 


The solution is Q(t) = 6t. Also, the volume of water in the tank is 
V =10+4 2t. So, this solution for Q holds for V < 50, which means that 
t < 20. 


Phase 2: As before, Ri, = 6. For the outflow, the rate is 2 gal/sec and 
the concentration in the outflow is Q/50. This means that Roz = Q/25. 
Now, this phase starts at t = 20, and the amount of salt in the tank at 
the start is 120 (this comes from the solution for Phase 1). This means 
that the problem to solve is 


dQ 1 
HO Be for 20 < t, 
Q(20) = 120. 


What is different about this problem is the time interval, which is not the 
usual 0 < t. However, this does not interfere with our solution methods, 
and the solution can be found using an integrating factor or separation of 
variables. One finds that the general solution of the differential equation 
is 

Q(t) = 150 + AeW*/*5, 
From the requirement that Q(20) = 120 it follows that A = —30e*/9. 


The Solution: Combining the Phase 1 and Phase 2 solutions, we get 


Q(t) = 


6t if 0<t< 20, 
150 — 30e29-9)/25 if 20<t. El 


2.3.2 » Newton’s Second Law 


Suppose an object with mass m is moving along the z-axis. Letting 


x(t) be its position, then its velocity is v = a and its acceleration is 
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d2x dv 


a= Fr = Gq. If the object is acted on by a force F’, then from Newton’s 
second law, which states that F = ma, we have that 
du 
—=F. 2.33 
ma (2.33) 


What sort of differential equation this might be depends on how F' de- 
pends on v. Once (2.33) is solved for v, then the position is determined 
by integrating the equation 

“ =v. (2.34) 
Typically, the initial velocity v(0) and initial position x(0) are given, 
and these are used to determine the integration constants obtained when 
solving the problem. 


Vertical Motion 


The object is assumed to be moving vertically, either up or down (see Fig- 
ure 2.3). In this case, x(t) is the distance of the object from the ground. 
It is also assumed that it is acted on by gravity, F,, and a drag force, Fy. 
Consequently, the total force is F = F,+ Fy. As for what these forces are: 


Gravitational force: Assuming the gravitational field is uniform, then 
Fy = —mg, where g is the gravitational acceleration constant. The minus 
sign is because the force is in the downward direction. 


Drag force: As long as the object is not moving very fast, the drag is 
proportional to the velocity (see Exercise 10). In this case, Fy = —cuv, 
where c is a positive constant. The minus sign is because the force is in 
the opposite direction to the direction of motion (so, Fy points upward if 
the object is falling). 


Units and Values: In the exercises, the value to use for g is usually stated. 
If it is not given, then you should leave g unevaluated. Whatever value is 
used, it is only approximate. If a more physically realistic value is needed, 
then you should probably use the Somigliana equation. Finally, weight 


—j 
ies] 
a 


rec 
‘Py, 
% 


x(0 Le 


Figure 2.3. Forces on a falling object. 
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is a force, so for an object that weighs w lbs, its mass can be determined 
from the equation w = mg. 


Example: Suppose a ball with a mass of 2kg is dropped, from rest, 
from a height of 1000m. Assume that the forces acting on the object are 
gravity, and a drag force due to air resistance, with c = 5 kg/ s. Assume 
that g = 10m/s?. 


Question 1: What is the resulting IVP for v, and what problem must be 

solved to find x? 
Answer: Since F = F,+ Fy = —mg-—cv, where m = 2 and c = 1/2, 
then from (2.33) the differential equation is 

dv 1 

— =-10--v. 2.35 

dt 4" (2:28) 
Since the object is dropped from rest, then the initial condition is 
v(0) = 0. Once v is known, then x is found by integrating (2.34), 
and using the fact that z(0) = 1000. Also, note that v is measured 
in meters per second, ¢ is measured in seconds, and x in meters. 


Question 2: What is the solution of the IVP, and the resulting solution 
for x? 
Answer: Using the integrating factor solution (2.21), it is found 
that the general solution is v = —40 + ce~*/4. Applying the initial 
condition we get that 


v = 40(-1+ e-/4), (2.36) 


Integrating x’ = 40(—1 + e7*/*), yields « = 40(-t — 4e7“/4) +c. 
Since x(0) = 1000, then c = 1160. So, « = 40(—t — 4e~*/4) + 1160. 


Question 3: What is the terminal velocity ur of the object? 
Answer: The terminal velocity is defined as 


UT = Jim u(t). 


Consequently, from (2.36), we get that vp = —40m/s. It is also 
possible to determine vp without solving the IVP, and how this is 
done is explained in Section 2.4. 


Question 4: When does the object hit the ground? 
Answer: It hits the ground when xz = 0, which means that it is the 
value of t that satisfies t + 4e~'/4 = 29. This can be solved using a 
computer, but it is possible to obtain an approximate value fairly 
easily. Assuming it takes several seconds to hit the ground, then 
the 4e~*/4 term should be relatively small. For example, at t = 10, 
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4e—t/4 = 0.3, and at t = 20, 4e~*/4 = 0.03. Consequently, as an 
approximation, we can replace the equation t + 4e~'/4 = 29 with 
t = 29. In comparison, the numerically computed value is about 
28.997s. 


2.3.3 » Logistic Growth or Decay 


An assumption often made for the growth of the population of a species is 
that the population grows at a rate proportional to the current population. 
If P(t) is the population at time t, then this assumption results in the 
equation P’ = kP. The solution is P(t) = P(0)e*, which means that 
there is exponential growth in the population. This is not sustainable in 
the real world, and it is more realistic to assume that the rate of growth 
slows down as the population increases. In fact, if the population is very 
large, the population should decrease instead of increase. A simple model 
for this is to assume that k = r(1 = £), where r and WN are positive 
constants. The resulting differential equation is 


“ = r(1 = -)p (2.37) 
which is known as the logistic equation. This nonlinear equation can be 
solved using separation of variables, and partial fractions. Doing this, in 
the case of when 0< P< JN, 


N 


——_—— dP = 2. 
(N—P)P* rdt (2.38) 
=> 
1 1 
= P= 
| (e+e [rae 
=> 
In =rt+c 
=> 
P erite 
N-—P ; 
From this, we get 
P=(N — Phee™, (2.39) 


where ¢ = e° is a positive constant. Doing the same thing for the case of 

when N < P, one again gets (2.39) except that ¢ is a negative constant. 

Moreover, for the divide by zero case of when P = 0, you get (2.39) but 

c¢ = 0. In other words, except for when P = N, (2.39) holds with the 

understanding that ¢ is an arbitrary constant. Solving (2.39) for P yields 
Née"™ 


Pa (2.40) 
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| 
0 
t-axis 


Figure 2.4. The logistic function (2.40), for —co < t < ov, in the case of 
when P(0) < N. 


where ¢ is an arbitrary constant. If P(0) = Po, and if Py 4 N, then 
one finds that €¢ = P)/(N — Po). When P(0) = N, this is a divide by 
zero situation in (2.38), and the resulting solution is just the constant 
PU) =N. 

The solution we have derived in (2.40) is known as the logistic function 
or the logistic curve. When plotted for —oo < t < o it has a 8, or 
sigmoidal, shape as shown in Figure 2.4. It is one of those functions that 
appears in so many applications that it deserves its own graph in this 
textbook (hence Figure 2.4). 


2.3.4 » Newton’s Law of Cooling 


The assumption is that the rate of change of the temperature of an object 
is proportional to the difference between its temperature and the ambient 
temperature (i.e., the temperature of its surroundings). This is often 
referred to as Newton’s law of cooling, but it also applies to heating an 
object. 

To write down the mathematical form of this statement, we introduce 
the following: 


T(t): This is the temperature of the object at time t. 
Ta: This is the ambient temperature. 
k: This is the proportionality coefficient. 


If the initial temperature of the object is Jo, then the resulting IVP for 
T is: 


< = —k(T — Tu), (2.41) 
T(0) =p. (2.42) 


This problem can be solved using the integrating factor solution (2.21), or 
by using separation of variables. It is found that T = T, + (Tp — Tn )e~™. 
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Example 1: Cooling a Cup of Coffee 


According to the National Coffee Association, the ideal temperature for 
brewing coffee is 200° F, and to get the most flavor out of it, you should 
drink it when the coffee is between 120 and 140° F. 


Question 1: If the room temperature is 70° F, what is the solution of the 
resulting [VP for T? 


Answer: Since To = 200 and T, = 70, then 


T= 70 1306, (2.43) 


Question 2: If the temperature is 180° F after 2 minutes, determine k. 


Answer: From (2.43), 180 = 70+ 130e~?*. From this one finds that 
k = §In(13/11) +. 

Question 3: When should you start drinking the coffee (according to the 
National Coffee Association)? 


Answer: The time when T = 140 occurs when 140 = 70 + 130e7**, 
from which one finds that 
= In(13/7) 


3/11) a) 


Question 4: What is the computed value for the answer for Question 3? 


Answer: It ist ~7.4 minutes. 


Example 2: Nonlinear Cooling 


Experimentally it has been observed that for certain fluids the k in (2.41) 
is not constant. To account for this, according to what is known as the 
Dulong-Petit law of cooling, the k in (2.41) is replaced with k(T —T,)'/*. 
The resulting differential equation is 


dT 
meee) keel Se 
dt ( a) 
This requires cooling, and so it requires T > Ty. 


Question: As in Example 1, suppose that the room temperature is 70° F 
and T(0) = 200° F. What is the solution of the resulting IVP? 


Answer: Separating variables, 


dT 
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Integrating this equation and then solving for T, 


ene 
(T—70/4 
7 4 
pT —70)/4 = 
( m0) kt +e 
=> 


T = 70 =. 

ae Gen, 

Since T(0) = 200, then the above equation gives us that 130 = 
(4/c)*. Solving this we obtain c= 4/130'/4. 


Reality Check: The models that are considered here are used to illustrate 
how, and where, differential equations arise. As with all models, simplify- 
ing assumptions are made to obtain the resulting mathematical problem. 
Many of these assumptions are not considered or accounted for in our 
examples, and the same is true for the exercises. As a case in point, New- 
ton’s Law of Cooling is usually limited to cases of when |T’ — T,| is not 
very large, and its applicability depends on whether the heat flow is due 
to conduction, convection, or radiation. Said another way, if you want to 
impress your family at Thanksgiving by using the solution of the cook- 
ing a turkey exercise (see below), just make sure to check on the turkey 
temperature regularly to make sure your predictions are correct. 


Exercises 


In answering the following questions, do not numerically evaluate numbers 
such as V2, 7/3, e?, In(4/3), etc. The exception to this is when the 
question explicitly asks you to compute the answer. 


1. The IVP for radioactive decay was derived in Example 1, on page 1. 


a) What is the solution of the IVP for a radioactive material? 

b) If 12 mg of a radioactive material decays to 9 mg in one day, find k. 

c) The half-life of a radioactive material is the time required for it to 
reach one-half of the original amount. What is the half-life of the 
material in part (b)? 

2. Radiocarbon dating uses the decay of carbon-14 to estimate how long 
ago something died. The assumption is that the amount of carbon- 
14 satisfies the radioactive decay problem derived in Example 1, on 
page 1. 


a) What is the solution of the IVP for a radioactive material? 
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b) The half-life of a radioactive material is the time required for it to 
reach one-half of the original amount. The half-life of carbon-14 is 
5,730 years. Use this to determine k. 


c) The amount of carbon-14 is the same in all living organisms. When 
an organism dies the amount starts to undergo radioactive decay. 
So, for radioactive dating you know No, as well as the current value 
of N. Explain how knowing No, N, and k can be used to determine 
t (which is the time that has passed since the organism died). 


d) Measurements in 1991 determined that the amount of carbon-14 
in the Temple Scroll, which is one of the Dead Sea scrolls found 
at Qumran, to be 186.18. The amount in living organisms is 238. 
Determine (i.e., compute) what two years the scroll could have been 
written in. Note that in the BC/AD system there is no year zero, 
so it goes from 1 BC to 1 AD. 

Comments: In this problem, the amount of carbon-14 refers to the 
amount relative to carbon-12. Also, the organism is the parchment 
from the scroll, and the testing is described in Bonani et al. [1992]. 


Mixing 


3. A tank contains 100L of salt water with a concentration of 2g/L. To 
flush the salt out, pure water is poured in at 4L/min, and the mixture 
in the tank flows out at the same rate. 


a) What is the resulting IVP for the total amount Q(t) of salt in the 
tank? 

b) Solve the IVP determined in part (a). 

c) How long does it take until the amount of salt in the tank is 1% of 


its original amount? 


4. A tank contains 20L of fresh water. Suppose water, containing ; g/L 
of salt, starts to flow into the tank at 2L/min, and the well-stirred 
mixture flows out at the same rate. 


a) What is the resulting IVP for the amount Q(t) of salt in the tank? 
b) Solve the IVP determined in part (a). 
c) How much salt is in the tank after one hour? 


5. Ten years ago, a factory started operation in a pristine valley. The 


valley’s volume is 10°m?. Each year the factory releases 10° m® of 
exhaust through its smoke stacks, and this exhaust contains 1000 kg of 
pollutants. Assume that the well-mixed polluted air leaves the valley 


at 10° m3/yr. 
a) What is the IVP for the amount of pollutant in the valley? 


b) How much pollutant is in the valley now? 
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6. A small lake contains 60,000 gal of pure water. There is an inlet stream 
of pure water into the lake, as well as an outlet stream, both flowing 
at a rate of 100 gal/min. Suppose someone starts pouring water into 
the lake at the rate of 10 gal/min that contains 5 lbs/gal of a chemical, 
and they do this for 8 hours. While this happens the inlet stream of 
pure water is unchanged, and the outflow rate from the lake remains 
at 100 gal/min. 


a) What is the formula for the volume of the lake while the person is 
pouring? 

b) For t < 8, what IVP must be solved to determine the amount of 
the chemical in the lake? 

c) How much of the chemical is in the lake when the person stops 
pouring? 

d) Once the person stops pouring, what IVP must be solved to deter- 
mine how much of the chemical is in the lake? 


Newton’s Second Law 


7. A mass of 10kg is shot upward from the surface of the Earth with a 
velocity of 100 m/s. In addition to gravity, assume that there is a drag 
force Fy = —cv, where c = 5kg/s. Assume that g = 10 m/s’. 


a) Write down the IVP for v, and then find its solution. 
b) Find z. 
c) How high does the object get? 


8. A skydiver weighing 176lbs drops from a plane that is at an altitude 
of 5000 ft. Assume that g = 32 ft/s?. 


a) Before the parachute opens, the forces on the skydiver are gravity 
and a drag force Fy = —cv. Assuming v(0) = 0, write down the 
IVP for v, and then find the solution. 


b) It is claimed that the terminal velocity of a person falling is —120 mph. 
Use this to determine c. 


c) If the parachute is opened after 10s of free fall, what is the speed 
of the skydiver when it opens? 


d) Find the distance the skydiver falls before the parachute opens. 


e) When the parachute is open, the drag force increases by a factor 
of 8 from the free fall drag force. What is the resulting terminal 
velocity of the skydiver? 


9. A spherical object sinking to the bottom of a lake is acted on by three 
forces: a drag force Fy = —cv, a buoyant force Fy, and gravity F%. 
According to Archimedes’ principle, the buoyant force is equal to the 
weight of the water that is displaced by the sphere. 


Exercises 
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a) What is the formula for F, in terms of the sphere’s radius a, the 
water density p, and g? 

b) The differential equation for the velocity of the sphere has the form 
mu’ = A—cv. What is A? 

c) Assuming the sphere is released from rest, solve the resulting IVP 
for v. 

d) Find a formula for the terminal velocity in terms of c, a, p, and g. 
What condition must be satisfied if the sphere is sinking? 

e) Assume the object is released a distance L from the bottom of the 
lake. Also assume that it takes a while for it to hit the bottom. Use 
an approximation similar to the one used in Question 4 on page 24 
to derive an approximate formula for the time it takes it to hit the 
bottom. 


Drag Force 
—_ 
o 
rs 
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Figure 2.5. Drag force on a smooth sphere as a function of the speed [Roos 


and Willmarth, 1971, NASA, 2020]. The function Fy is used in Exercise 10. 


10. A spherical object falling in the atmosphere is acted on by gravity, Fy, 


and a drag force Fy. It is assumed that Fy = —cv(1 — Sv), where v is 
the velocity. Both c and £ are positive constants. 


a) Assuming the sphere is dropped from rest, what is the resulting 
IVP for v? 

b) Solve the IVP for v. 

c) Find a formula for the terminal velocity in terms of m, c, 8, and g. 


d) The constants in Fy are c = 67Ry and B = Rp/(9rp), where R is 
the radius of the sphere, p is the air density, and yu is the air viscosity. 
For a baseball falling in the atmosphere, R = 0.037, = 1.8 x 107°, 
and p = 1.2 (using kg, m, s units). Also, m = 0.14 and assume that 
g = 9.8. Compute the terminal velocity. How does this compare to 
what is the speed of a typical fastball in professional baseball? 
Comment: The drag force used in this problem is close to what is 
observed experimentally. To demonstrate this, the experimentally 
determined values of the drag, and the values determined using Fy, 
are shown in Figure 2.5 as a function of the speed |v|. This data 
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also shows that the assumption Fy = —cv is only valid if the speed 
is no more than about 107? m/s. 


Logistic Growth or Decay 


11. It is often found that a population will grow exponentially if the popu- 
lation is very small, and it will decrease exponentially if the population 
is very large. A model for this is due to Beverton and Holt, and the 
equation to solve is 


y—2£ 
P! =r—_P, 
Lae 


where r and WN are positive constants. 


a) Assuming that P(0) = 5N, solve the resulting IVP for P. 
b) What is the limiting population P(oo) = limj_,.. P(t)? 
12. The population of fish in a large lake can be modeled using the logistic 


equation. If, in addition, the fish are caught at a constant rate h, the 
equation for the population becomes 


Pi=r(1—7)P—h, 


where r and WN are positive constants. In this problem take r = 4, 
h = 750, and N = 1000. Also, P(0) = 1000. 
a) Solve the IVP for P. 


b) What is the limiting population? In other words, what is P(co) = 


Cooling or Heating 


13. Suppose coffee has a temperature of 200° F when freshly poured, and 
the room temperature is 72°F. In this exercise use Newton’s law of 
cooling. 

a) What IVP does the temperature of the coffee satisfy? 
b) What is the solution of the TVP? 
c) If the coffee cools to 136° F in five minutes, what is k? 


d) When does the coffee reach a temperature of 150° F? 
14. Redo the previous exercise but use the Dulong-Petit law of cooling. 


15. To cook a turkey you are to put it into a 350°F oven, and cook it 
until it reaches 165°F. In answering the following questions, assume 
Newton’s law of cooling is used. 


a) Suppose the turkey starts out at room temperature, which is 70°F. 
What IVP does the temperature satisfy? 
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b) Suppose that after two hours in the oven, the temperature of the 
turkey is 140°F. How much longer before it is done? 


c) Suppose the turkey is taken from the refrigerator, which is set to 
40°F, and put directly into the oven. How much longer does it take 
to cook than when the turkey starts out at room temperature? The 
value for k is the same as in part (b). 


16. A homicide victim was discovered at 1 p.m. in a room that is kept at 
70°F. When discovered, the temperature of the body was 90°F, and 
one hour later it had dropped to 85°F. 


a) Assuming Newton’s Law of Cooling, and normal body temperature 
is 98.6°F, how long had the person been dead when the body was 
discovered? 


b) Compute the time of death. Round your answer so it just gives the 
hour and minute (e.g., 7:13a.m. or 5:32 p.m.). 


17. Suppose that in Newton’s Law of Cooling that k is found to depend 
on temperature. A common assumption is that k = ko + ki(T — Ty), 
where ko and ky are positive constants. 


a) What is the resulting differential equation for T’? 

b) To find T it makes things easier to introduce the variable S(t) = 
T(t) — Ta. Rewrite the differential equation in part (a) in terms of 
S. Also, if T(0) = To, what is S(0)? 

c) Solve the resulting IVP in part (b) for S, and then use this to show 
that 

koce™ Mot 

1 — kyce7kot ’ 
where c = So/(ko + k1So) and So = To — Ta. 

d) Using (2.43), it was found you have to wait about 7.4 minutes to 


drink the coffee. Taking ko = 5 In(13/11) and k; = 0.01, compute 
how long you need to wait using the solution for T from part (c). 


T=T,+ 


2.4 » Steady States and Stability 


All of the applications considered in the previous section have one thing in 
common: the solution eventually approaches a constant value, or steady 
state. This is not unusual, as this is what often happens. What is of 
interest here is whether it is possible to determine the eventual steady 
state without actually having to solve the problem. 

To illustrate, as explained in the previous section, the population P(t) 
of a species is determined by solving 


P' = f(P), (2.45) 
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Figure 2.6. Solution of (2.45) and (2.46) in the case of when P(O) = 0.1, 
and when P(0) = 4.5. The dashed red lines are the steady state values. 


where, for this example, we will take 
{(P)=286—P je. (2.46) 


The solution of this equation is given in (2.40), and it is plotted in Figure 
2.6 for the case of when P(0) = 0.1, and when P(0) = 4.5. It shows that 
for both initial values, the population approaches, asymptotically, P = 3. 
In both cases the approach is monotonic, either increasing or decreasing. 

What is important for this discussion is that it is possible to determine 
the general behavior of the solution seen in Figure 2.6 without solving the 
problem. This requires the following three observations: 


Steady States: If the solution does asymptotically approach a constant 
value P, then P = P must be a solution of the differential equation. 
This means that it is required that f(P) = 0. From this and (2.46) 
we get the two values P = 0 and P = 3. These are called steady 
states for this equation. 


Unstable: Even though the initial value P(0) = 0.1 is close to the steady 
state P = 0, the solution moves away from P = 0. This happens 
because of f(P). To explain, the function f(P) is plotted in Figure 
2.7. It shows that f(P) > 0 for 0 < P < 3. So, in this interval 
P’(t) > 0, and this means that P is increasing. Similarly, since 
f(P) < 0 for 3 < P, then P is decreasing in this interval. The 
arrows in Figure 2.7 indicate the corresponding movement of P. The 
conclusion we derive from the arrows is that if P(0) is anywhere in 
0 < P <3, then the solution will move away from the steady state 


P=0. Because of this, the steady state is said to be unstable. 


Stable: The second conclusion we make from the arrows in Figure 2.7 is 
that if P(O) is anywhere in 0 < P < 3, then the solution increases 
towards the steady state P = 3. Moreover, if P(0) is anywhere in 
3 < P, then the solution decreases towards the steady state P = 3. 


2.4. Steady States and Stability 35 


9 T T T T 
f(P) >0 = P increasing | f(P) <0 => P decreasing | 


J(P) 


Figure 2.7. The function f(P) in (2.46). The two steady states are shown 
by the reds dots. The arrows indicate the direction P moves in the respective interval. 


A consequence of this is that, no matter what initial condition we 
pick near P = 8, 
lim P(t) =3. 


too 


For this reason, P = 3 is said to be an asymptotically stable 
steady state. 


The key to what guarantees that the steady state P = 3 is asymptot- 
ically stable is that f(P) is positive to the left of P = 3, and negative to 
the right of it. In other words, f(P) is a deceasing function at P = 3. 
Consequently, if f’(3) < 0 then P = 3 is asymptotically stable. A similar 
test can be made for an unstable steady state. 


2.4.1 » General Version 


The reasoning used in the above example is easily extended to more gen- 
eral differential equations. To do this, assume that the equation is 


y = f(y) (2.47) 


where f’(y) is a continuous function of y. Because f(y) is assumed to 
not depend explicitly on t, the equation is said to be autonomous. So, 
y =1+y? is autonomous, but y’ = t+ y° is not. 


Steady State. y = Y is a steady state for (2.47) if it is constant and 
f(Y)=0. 


Stability Theorem. A steady state y = Y is asymptotically stable if 
f'(Y) <0 and it is unstable if f'(Y) > 0. 


The idea underlying asymptotic stability is that if y(0) is any point close 
to Y, then 


lim at) =. (2.48) 
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To explain this more mathematically, a steady state is either stable or 
unstable. It is stable if you can control how far the solution gets from Y 
by picking y(0) close to Y. Specifically, given any ¢ > 0, you can find a 
6 >0 so that |y(t) — Y| < « if |y(0) — Y| < 6. If this is not possible then 
Y is unstable. So, the steady state P = 0 in Figure 2.7 is unstable as it 
is not possible to find P(0)’s near P = 0 that will result in the solution 
staying near P = 0. 

In addition, a stable steady state is either asymptotically stable, which 
means that the limit (2.48) holds, or it is said to be neutrally stable. The 
latter occur, for example, for the steady states of y’ = 0. Neutrally stable 
steady states are not considered in this chapter but will be in Chapters 4 
and 5. 

The case of when y(0) = Y merits a comment. No matter if the steady 
state is stable or unstable, if y(0) = Y, then y(t) = Y is a solution of the 
resulting IVP. Consequently, what is of interest is what the solution does 
if you start close, but not exactly at, a steady state. 


Example 1: Find the steady states, and determine their stability, for 
y=y?—y—6. 


Answer: The steady states are found by solving y? — y—6 = 0, and 
from this we get Y = 3 and Y = —2. To determine their stability, 
since f(y) = y? — y — 6, then f’(y) = 2y — 1. Since f’(3) =5 > 0, 
then Y = 3 is unstable, and since f’(—2) = —5 < 0, then Y = —2 
is asymptotically stable. 


2.4.2 » Sketching the Solution 


As demonstrated in the above example, the stability theorem makes it is 
relatively simple to determine if a steady state is stable or unstable. It 
is also relatively easy to sketch the solution, and the following example 
illustrates how this is done. Moreover, as you will see, this is done using 
nothing more than the sketch of the function f(y). 


Example 2: Sketch the solution of y/ = f(y), where f(y) is given in 
Figure 2.8. 


Answer: To do this it is necessary to know y(0). Before picking this value, 
we first see what can be determined about the solution. 


Steady States: The steady states are the points where f(y) = 0. From 
Figure 2.8, this happens when y = —2, y = 1, and y = 3. These are 
identified using red dots in the figure. From the graph it is evident 
that f’(—2) < 0 and f’(3) < 0, and this means that y = —2 and 
y = 3 are asymptotically stable. Similarly, since f’(1) > 0, then 
y = 1 is unstable. 
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Figure 2.8. The sketch of the function f(y) for Example 2. 


Increasing or Decreasing: If f(y) > 0, then the solution is increasing, and 
if f(y) < 0, then the solution is deceasing. The respective y intervals 
where this happens are shown in Figure 2.8 using arrows. 


We will now use the above conclusions to sketch the solution. 


y(0) = 1.3: This point is located between two steady states, specifically, 
1 < y(0) < 3. According to Figure 2.8, y(t) increases monotonically 
in this interval, and asymptotically approaches y = 3. A curve with 
these properties is shown in Figure 2.9. 


y(0) = 0.8: In this case, the point is located between two steady states, 
namely, —2 < y(0) < 1. From Figure 2.8, y(t) decreases monoton- 
ically in this interval, and asymptotically approaches y = —2. A 
curve with these properties is shown in Figure 2.9. 


y(t) 


Figure 2.9. Solution curves obtained using the information in Figure 2.8. 
The dashed red lines are the steady state values. 
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f(y) 


Figure 2.10. The sketch of the function f(y) for Example 8. 


y(0) = —4: For this initial condition, according to the information in Fig- 
ure 2.8, y(t) increases monotonically, and asymptotically approaches 
y = —2. A curve with these properties is shown in Figure 2.9. 


In the above example, each initial condition resulted in the solution 
approaching one of the steady states. As illustrated in the next example, 
this does not always happen. 


Example 3: For y’ = y, find the steady states, determine their stability, 
and then sketch the solution when y(0) = 0.1, and when y(0) = 
—0.1. 


Answer: Since f(y) = y then y = 0 is the only steady state. Also, 
since f’(y) = 1 > 0, the steady state is unstable. The corresponding 
intervals where y is increasing or decreasing are shown in Figure 
2.10 using arrows. The resulting solution curves for the given initial 
conditions are shown in Figure 2.11. For both initial conditions the 
solution moves away from y = 0. In the case of when y(0) = 0.1, 
y(t) > co ast > oo. This is because y'(t) > 0, so the solution curve 
is strictly monotonically increasing. The solution does not level off, 
like the y(0) = 1.3 curve in Figure 2.9, because there is no steady 


Figure 2.11. Solution curves obtained using the information in Figure 2.10. 
The dashed red line is the steady state value. 
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state for y > 0. For a similar reason, when y(0) = —0.1, y(t) ~ —co 
ast—oo. 


The sketching procedure used in Examples 2 and 3 leaves some things 
undetermined. For example, nothing was said about how steep the curves 
are, or whether they are concave up or down. It is possible to determine 
this using Figures 2.8 and 2.10, but this level of analysis is not considered 
in this text. 


2.4.3 » Parting Comments 


A few closing comments about the material in this section are in order. 


1. What is defined as a steady state here is sometimes called a critical 
point, or an equilibrium point. Referring to them as a steady state 
is consistent with what is used for time independent solutions of 
partial differential equations. 


2. The stability theorem does not cover the case of when f/(Y) = 0. 
However, the graphical method, as in Figure 2.7, can still be used. 


3. When a solution moves away from an unstable steady state, it does 
not necessarily approach the closest stable steady state. An example 
of this is shown in Figure 2.9. Although Y = 3 is closer to the initial 
point y(0) = 0.8, f(y) is negative for —2 < y < 1, and this means 
the solution must decrease. 


Exercises 


1. For each equation, verify that Y = 0 is a steady state. Determine if it 
is unstable or asymptotically stable. 


a) y’ =sin(1 — e¥) c) y’ = —e” sin(y) 
b) y =y? — By? +y d) yf =(1+y°) In + y) 


2. For each differential equation, find the steady states and determine if 
they are asymptotically stable or unstable. 


a) y =y*+y-2 f) y =y* — 8y?-4 

b) yf =34+2y-y? Jt acer 

ejay Sy h) yf =(1+y)—-(1+y)8 

d) y¥ =4y-y? i) f=(1+y*)*-(+y) 
e) ¥=e¥-2 j) y =n(6+y) —In(y’) 
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Sketch the solution curve for each of the given initial conditions. 


a) f=yt+y-2 d) y =e ¥-2 
y(0) = —3; y(0) =0 y(0) = 1; y(0) =2 

b) y=ye-y e) y =y* -3y?-4 
y(0) = 3/4; y(0) = —-1/4 y(0) = 1; y(0) = -3 

c) ¥ =4y-y? f) y' =e — 4e¥ +3 
y(0) = 1/2; y(0) =3 y(0) = —1; y(0) =In2 


. Sketch the solution of y’ = f(y) based on the information provided. 


Assume that f(y) is zero only at y = —2 and y = 3. 


a) f(2) =—4, b) g(=2)= 1, c) f'(3) = 2, 
y(0) =1 y(0) =0 y(0) =—1 


. This problem concerns the steady states and stability for y’ = f(y), 


where f(y) is one of the functions plotted in Figure 2.12. You should 
assume the only solutions of f(y) = 0 are the locations shown in the 
plot. For the respective plot, do the following: (i) find the steady states 
and determine if they are asymptotically stable or unstable, and (ii) 
sketch the solution when y(0) = a, y(0) = GB, and y(0) = 7. 

a) For plot (a), with a = —2.5, 8B =0, y =2.5. 

b) For plot (b), with a = —2.5, 8 =0, y = 2.5. 

c) For plot (c), with a = —2.5, 8 =0, y = 2.5. 

d) For plot (d), with a = —2.5, 8 = —0.5, y = 1.5. 


. For the mixing problem given in (2.31), (2.32), sketch the solution 


without using the formula for the solution. Make sure to explain how 
you do this. 


b) 
0 So 
— 
3 2 1 0 1 2 3 3 2 -1 0 1 2 3 
y-axis y-axis 
d) 
0 So 
—_ 
3 2 1 0 1 2 3 3 2 -1 0 1 2 3 
y-axis y-axis 


Figure 2.12. Plots of f(y) used in Exercise 5. 


Exercises 


10. 


11. 
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. For the population problem in Exercise 11, on page 32, sketch the so- 


lution without using the formula for the solution. Use this to answer 
part (b) of that exercise. 


. For the drag on a sphere, as described in Exercise 10 on page 31, de- 


termine the terminal velocity without solving the IVP. In other words, 
answer part (c) using only part (a) of that exercise. 


. This problem concerns solving y! = —\/1+ y, where y(0) = 0. 


a) Using separation of variables, what is the solution? It helps to 
note, from the differential equation, that y/(0) = —1. 


b) Using the method outlined in Example 2, sketch the solution. 


c) Sketch the solution you found in part (a). Assuming your sketch 
in part (b) is correct, is there anything wrong with your solution 
in part (a)? If so, how should it be modified? Does your sketch 
from part (b) need to be modified as well? 


The population of fish in a lake can be modeled using the logistic 
equation. However, assuming that the fish are caught at a constant 
rate h, the equation for the population becomes 


P!=r(1- 5)P-h, 


where r and WN are positive constants. 


a) Assuming that the loss due to fishing is small enough that 0 < 
h<rN/4, find the two steady states for the equation. Label these 
values as P; and Py, where P; < Po. 

b) Determine whether P; and P) are unstable or asymptotically stable. 

c) Letting f(P) be the right hand side of the differential equation, 
sketch f(P) for 0 < P < oo. With this, answer the question in 
Exercise 12(b) on page 32. 

d) Assuming that P, < P(0) < P2, sketch the solution. Do the same 
for the case of when P; < P(0). 

e) Sketch the solution if 0 < P(0) < P;. In doing this remember that 
P(t) can not be negative. Note that you will find that there is a 
time te where extinction occurs, and the differential equation does 
not apply to the fish population for t. < t. 


The solution of a differential equation is shown in Figure 2.13. Explain 
why it can not be the plot of the solution of the following differential 
equations. You only need to provide one reason (even though there 
might be several). 
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a) y=1+y’ c) ¥ =(y—-4)(y—3)(y—1) 
b) y =y-4 d) y' = (y— 2)(4—y) 
Let?! ttl 
es | 
é | | | | | | | 
0 1 2 3 4 5 6 7 8 
t 


Figure 2.13. Plot used in Exercise 11. The starting point is y(0) = 2. 


12. The following refer to the solution of (2.47), where f(y) is continuous. 
Sketch a function f(y) so the stated conditions hold. Make sure to pro- 
vide a short explanation of why your function satisfies the conditions 
stated. If it is not possible to find such a function, explain why. 


a) The solution is strictly monotone increasing for y < 0, is strictly 
monotone decreasing for y > 0, and there are no steady states. 


b) The only asymptotically stable steady state is Y = 0, and the only 
unstable steady states are Y = —1 and Y = 1. 


c) The only asymptotically stable steady state is Y = 0, and the only 
unstable steady states are Y = 1 and Y = 2. 


13. This problem concerns what is known as one-sided stability, or semi- 
stability. The differential equation considered is 


y! = 2(3 — y)?. 


a) Show that there is one steady state Y, and f’(Y) =0. 

b) Sketch f(y) for —co < y < oo. Use this to explain why, except 
when y = Y, y is an increasing function of t. 

c) Using the same reasoning as for the population example, explain 
why, if y(0) < Y, then lim:+. y(t) = Y. However, if y(0) > Y, 
then lim: + y(t) = oo. 

d) Use the results from part (c) to explain why this is an example of 
one-sided stability. 


Chapter 3 


Second-Order Linear 
Equations 


The general version of the differential equations considered in this 
chapter can be written as 


dy dy 


ae + ally = F(t), (3.1) 


+ p(t) 


where p(t), g(t), and f(t) are given. One of the reasons this equation gets 
its own chapter is Newton’s second law, which, if you recall, is F = ma. 
To explain, if y(t) is the displacement, then the acceleration is a = y”, 
and this gives us the differential equation my” = F. In this chapter we 
are considering problems when F is a linear function of velocity y’ and 
displacement y. Later, in Chapter 5, we will consider equations where the 
dependence is nonlinear. It is because of the connections with the second 
law that f(t) in (3.1) is often referred to as the forcing function. 

In the previous chapter, for first-order linear differential equations, we 
very elegantly derived a formula for the general solution. This will not 
happen for second-order equations. All of the methods derived in this 
chapter are, in fact, just good, or educated, guesses on what the answer 
is. There are non-guessing methods, and one example involves using a 
Taylor series expansion of the solution. An illustration of how this is 
done can be found in Exercise 8 on page 54. 

To use a guessing approach, it becomes essential to know the math- 
ematical requirements for what can be called a general solution. This is 
where we begin. 
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3.1 «= Initial Value Problem 


A typical initial value problem (IVP) consists of solving (3.1), for t > 0, 
with the initial conditions 


y(0)=a, and y'(0)=8, (3.2) 


where a and § are given numbers. Because our solution methods involve 
guessing, it is important that we know when to stop guessing and conclude 
we have found the solution. This is why the next result is useful. 


Existence and Uniqueness Theorem. /f p(t), g(t), and f(t) are con- 
tinuous for t > 0, then there is exactly one smooth function y(t) that 
satisfies (3.1) and (3.2). 


In stating that y(t) is a smooth function, it is meant that y’(t) is defined 
and continuous for t > 0. Those interested in the proof of the above 
theorem, or the theoretical foundations of the subject, should consult 
Coddington and Carlson [1997]. 

So, according to the above theorem, if we find a smooth function that 
satisfies the differential equation and initial conditions, then that is the 
solution, and the only solution, of the IVP. 


3.2 » General Solution of a Homogeneous Equation 


The associated homogeneous equation for (3.1) is 


+ p(t)— 4+ q(t)y = 0. (3.3) 


We need to spend some time discussing what it means to be the general 
solution of this equation. So, consider Exercise 5(a), in Section 1.2. As- 
suming you did this exercise, you found that given solutions y; = e?’ and 
yo = et of y” — 3y’ + 2y = 0, then 


y(t) = cryi(t) + coya(t) (3.4) 


is a solution for any value of c, and cg. What is important here is that this 
is a general solution of the differential equation. Roughly speaking, this 
means that any, and all, solutions of the differential equation are included 
in this formula. A more precise statement is that, no matter what the 
values of a and 3, there are values for c; and c2 so that (3.4) satisfies the 
differential equation (3.3) as well as the given initial conditions in (3.2). 

This gives rise to the question: what is required so a solution like the 
one in (3.4) can be claimed to be a general solution? The answer is given 
in the next result. 
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General Solution Theorem. The function y(t) = cryi(t) + ceye(t), 
where cy and cg are arbitrary constants, is a general solution of (3.3) 
if the following are true: 


1. yi(t) and yo(t) are solutions of (3.3), and 
2. yi(O)y2(0) — ¥4(0)y2(0) 4 0. 


To explain where these two requirements come from, the first one guar- 
antees that y(t) is a solution of (3.3) no matter what the values of c; and 
cg. As for the initial conditions (3.2), they require that 


ce1yi(0) + cay2(0) =a 
cry (0) + c2y4(0) = 8B. 


’ 


Solving these equations, one gets 


ayn(0) — By2(0) 
yr (0)¥3(0) — 44 (0)y2(0) * 


with a similar expression for cy. So, as long as y1(0)y5(0) F y}(0)y2(0) 
it is possible to find c, and cz so the initial conditions are satisfied (no 
matter what the values of a and 3). In other words, y(t) is a general 
solution. 


cq = 


Example: Show that y = cje~* + ce! is a general solution of y/’ + 2y! — 
3y = 0. 


Answer: In this case, y;(t) = e~** and yo(t) = e®. It is not hard to 
show that they are solutions of the differential equation (see Section 
1.2). To check on the second requirement, note that y, = —3e~* 
and y, =e’. So, yi(0)y$(0) — y (0)y2(0) = 4 40. Therefore, y is a 
general solution. MH 


3.2.1 » Linear Independence and the Wronskian 


It is possible to restate the General Solution Theorem given above as: 
“The function y(t) = cyi(t) + caye(t), where c; and co are arbitrary 
constants, is a general solution of (3.3) if y:(t) and yo(t) are linearly inde- 
pendent solutions of (3.3).” The requirement that y; and y2 are linearly 
independent means that the only constants cy; and co that satisfy 


c1yi(t) + caye(t) =0, Vt>0, (3.5) 


are cy = 0 and co = 0. This is, effectively, the same definition of linear 
independence used in linear algebra. The difference is that we have func- 
tions rather than vectors. If it is possible to find either c, # 0 or co 4 0 
so (3.5) holds, then y; and yz are said to be linearly dependent. Also, 
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in (3.5), the symbol V is a mathematical shorthand for “for all” or “for 
every.” 

The question arises about how the “independent solutions” version of 
the theorem is the same as the “y1(0)y5(0) — y,(0)y2(0) 4 0” version. To 
explain, given two solutions y; and y2 of (3.3), one way to determine if 
they are independent is to use what is called the Wronskian of y; and ype. 
This is defined as 

W(y1, y2) = det (" . . (3.6) 


Uy Yo 


For those unfamiliar with determinants, this can be written as 


W (yi, y2) = viy2 — y2ut- (3.7) 
The usefulness of this function is due, in part, to the next result. 


Independent Solutions Test. Jf y; and y2 are solutions of (3.3), then 
y1 and yg are independent if, and only if, W(y1, y2) is nonzero. 


The Wronskian comes into this problem because (3.5) must hold on the 
interval 0 < t < oo. So, (3.5) can be differentiated, which gives us the 
equation cyy} + coy = 0. This, along with (3.5), provides two equations 
for cy and cg. It is not hard to show that if W(y1,y2) # 0, then the 
only solution to these two equations is cy = co = 0. Consequently, if 
W(y1, y2) #0, then y; and y2 are independent. 

Now, as shown in Exercise 5, either W(y1, y2) is identically zero or else 
it is never zero. Given that y1(0)y5(0)—y} (0) y2(0) is the value of W(y1, y2) 
at t = 0, then from the Independent Solutions Test we conclude that y(t) 
and y2(t) are linearly independent if, and only if, yi(0)y5(0)—y} (0)y2(0) 4 
0. So, the two versions of the theorem are equivalent. 


Exercises 


“t is a general solution of 


1. Assuming w 4 0, show that y = ce“! + coe 
yf — wy = 0. 
ot is a general solution of y” +2ay' +a7y = 0. 


bt 


2. Show y = cje~™ 4 cote 


3. Assuming b # 0, show that y; = 1 and yo = e-” are independent 
solutions of y” + by’ = 0. 

4. Assuming w 4 0, show that y; = cos(wt) and y2 = sin(wt) are inde- 
pendent solutions of y” + wy = 0. 

5. If y, and yo are solutions of (3.3), show that SW + p(t)W = 0. Use 


this to derive Abel’s formula, which is that 
W (11, yo) = Woe fo P04, 
where Wo = yi(0)y5(0) — y}(0)y2(0) is the value of W at t = 0. 
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3.3 =» Solving a Homogeneous Equation 


The solution of the homogeneous equation 


d’y dy 
— + b— =0 3.8 
a ag Cy) 
can be found by assuming that y = e”. With this, y’ = re™, and y” = 
re", and so (3.8) becomes (r? + br + c)e™ = 0. Since e” is never zero, 
we conclude that 

r?+br+c=0. (3.9) 


This is called the characteristic equation for (3.8). It is easily solved 
using the quadratic formula, which gives us that 


r=5(-b4 VP—4). (3.10) 


2 


There are three possibilities here: 


1. there are two real-valued r’s: this happens when b? — 4c > 0, 
2. there is one r: this happens when b? — 4c = 0, and 
3. there are two complex-valued r’s: this happens when b? — 4c < 0. 


The case of when the roots are complex-valued requires a short introduc- 
tion to complex variables, and so it is done last. 


3.3.1 » Two Real Roots 


When there are two real-valued roots, say, r; and rz, then the two cor- 
responding solutions of (3.8) are y; = e"!! and yg = e"*. It is left as an 
exercise to show they are independent. Therefore, the resulting general 
solution of (3.8) is 


y = ce! + cge™?. 


3.3.2 « One Real Root and Reduction of Order 


When there is only one root, the second solution can be found using 
what is called the reduction of order method. To explain, if you know a 
solution y(t), it is possible to find a second solution by assuming that 
yo(t) = w(t)yi(t). In our case, we know that y(t) = e”, where r = 
—b/2, is a solution. So, to find a second solution it is assumed that 
y(t) = w(t)e™. Substituting this into (3.8), and simplifying, yields the 
differential equation 


w" + (2r + bw! +r? 4+ or+e=0. 


Since r = —b/2, and 4c = b?, then the above differential equation reduces 
to just w” = 0. Integrating this once gives w’ = d, and then integrating 
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again yields w = d,t+ dg, where d, and dz are arbitrary constants. With 
this our second solution is y = (djt+d2)e"™. A solution that is independent 
of y; = e” is obtained by taking d; = 1 and dy = 0, which means 
that yo = te™. The fact that they are independent follows from the 
Independence Test since W(y1,y2) = 2e” is nonzero. Therefore, the 
resulting general solution of (3.8) is 


y = ce” + cote”. 


3.4 » Complex Roots 


An example of a differential equation that generates complex-valued roots 
is 

y” +4y' + 13y = 0. (3.11) 
Assuming y = e”, we obtain the characteristic equation r? + 4r +13 = 0. 
The two solutions of this are rj = —2 + 32 and rg = —2 — 37. Proceeding 
as in the case of two real-valued roots, the conclusion is that the resulting 
general solution of (3.11) is 


y= cet +4 cge"2" 


= eyelet + eel 2- Sit, (3.12) 


Because complex numbers are used in the exponents, if this expression is 
used as the general solution, then c, and cz must be allowed to also be 
complex-valued. 

Although solutions as in (3.12) are used, particularly in physics, there 
are other ways to write the solution that do not involve complex numbers. 
Even if (3.12) is used, there is still the question of how to evaluate an 
expression such as e*’. For this reason, a short introduction to complex 
variables is needed. 


3.4.1 » Euler’s Formula and its Consequences 


The key for working with complex exponents is the following formula. 


Euler’s Formula. /f 6 is real-valued then 


e” — cosO + isin#. (3.13) 


It is not possible to overemphasize the importance of this formula. It is 
one of those fundamental mathematical facts that you must memorize. 
For those who might wonder how this formula is obtained, it comes from 
writing down the Maclaurin series of e’’, cos 0, and sin 6, and then showing 
that they satisfy (3.13). 
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As it must, (3.13) is consistent with the usual rules involving arith- 
metic, algebra, and calculus. The examples below provide illustrations of 
this fact. 


Example 1: Since, by definition, i = /—1, then i? = —1, i? = —i, and 
i+ =1. Also, 


(a + ib)? = (a + ib) (a + 2b) 
= a’? — b? + 2iab. 


It is useful to be able to identify the real and imaginary part of a 
complex number. So, if r=a-+ib, and a and 0 are real, then 


Re(r) =a, and Im(r) =6. 


As an example, Re(5 — 167) = 5, and Im(5 — 167) = —16. Finally, 
two complex numbers are equal only when their respective real and 
imaginary parts are equal. So, for example, to state that e = 
5V2(1 — i) requires that, using Euler’s formula, cos? = 5V2 and 


snd=-—35/2. fl 


Example 2: e’” = cosa +isinz = —1. 


This shows that the exponential function can be negative. More- 
over, since e’” = —1 then, presumably, In(—1) = im (ie., you can 
take the logarithm of a negative number). This is true, but there are 
complications related to the periodicity of the trigonometric func- 
tions, and to learn more about this you should take a course in 
complex variables. Hi 


Example 3: e'7/? = cos7/2+isin7/2=i. 


Example 4: Assuming @ and y are real-valued, then 


ee"? — (cosé + isind) (cosy + isin y) 
= cos cos y — sin # sin y + i(cos @ sin y + sin 6 cos y) 
= cos(6 + y) + isin(@ + y) 
= ell(Ote) | 


Example 5: Assuming r is real-valued, then 
d ; d 
ae =e (cos rt + isin rt) 
=-—rsinrt+ircosrt 
= ir(cosrt + isin rt) 


=ire”. Ef 
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The next step is to extend Euler’s formula to a general complex num- 
ber. With this in mind, let z = x + iy, where x and y are real-valued. 
Using the usual law of exponents, 


e= erty ~ et ely 
=e"(cosy+isiny). (3.14) 


The above expression is what we need for solving differential equations. 


3.4.2 » Second Representation 


We return to the general solution given in (3.12). With (3.14), we get the 
following 


= eye(—2 +88 4 ege(-2-38)t 


ce 
| 


= een ( cos 3t + 7sin 3t) + Ge ( cos 3¢ — 7sin 3t) 


(cy + c2)e~* cos 3t + i(e, — c2)e~*! sin 3¢. 


We have therefore shown that the general solution can be written as 
y(t) = dye~* cos 3t + doe” sin 3¢. (3.15) 


It is not difficult to check that the functions 7; = e~?’cos3t and J = 
e ~ sin3¢ are solutions of (3.11), and they have a nonzero Wronskian. 
Moreover, since #1, and Y2 do not involve complex numbers, then d, and 
dz in the above formula are arbitrary real-valued constants. 


3.4.3 » Third Representation 


There is a third way to write the general solution that can be useful when 
studying vibration, or oscillation, problems. This comes from making the 
observation that given the values of d; and dz in (3.15), we can write them 
as a point in the plane (d,,d2). Using polar coordinates, it is possible to 
find R and y so that d, = Rcosy and dz = Rsiny. In this case, 


y= die~~ cos 3t + dge~~ sin 3t 
= Re ( cos y cos 3¢ + sin y sin 3t) 
= Re~** cos(3t — y). (3.16) 


This last expression is the formula we are looking for. In this representa- 
tion of the general solution, R and y are arbitrary constants with R > 0. 
The advantage of this form of the general solution is that it is much easier 
to sketch the solution, and to determine its basic properties. Its downside 
is that it can be a bit harder to find R and vy from the initial conditions 
than the other two representations. 
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3.5 » Summary for Solving a Homogeneous Equation 


To solve 
y + by’ + cy = 0, (3217) 


where b and c are constants, assume y = e”*. This leads to solving the 


characteristic equation r? +br+c = 0, and from this the resulting general 
solution is given below. 


Two Real Roots: r = 11,12 (with r; #12). 


y = ce" + ce" (3.18) 


One Real Root: r = X. 


y = ce + cote (3.19) 


Complex Roots: r= \+ip (with » £0). Any of the following can be 
used: 


y = cpeOtyt 4. ge Atm) 


where c,,c2 are complex-valued, = (3.20) 
y = dye™ cos(pt) + dye sin(pt), where d}, dz are real-valued, (3.21) 
y = Re™ cos(t — y), where R,y are constants with R>0. (3.22) 


In what follows, (3.21) is used. The exception is in Section 3.10, where 
(3.22) is preferred because it is easier to sketch. 


Example 1: Find a general solution of y” + 2y/ — 3y = 0. 


Answer: The assumption that y = e™ leads to the characteristic 
equation r? + 2r — 3 = 0. The solutions of this are r = —3 and 
r =1. Therefore, a general solution is y = cye~** + coe’. 


Example 2: Find the solution of the IVP: y” + 2y’ = 0 where y(0) = 3 


and y'(0) = —4. 

Answer: The assumption that y = e™ leads to the characteristic 
equation r? + 2r = 0. The solutions of this are r = —2 and r = 0. 
Therefore, a general solution is y = cje~*! + cg. To satisfy y(0) = 3 
we need cy + co = 3, and for y/(0) = —4 we need —2c, = —4. 


This gives us that cy = 2, and cg = 1. Therefore, the solution is 
y=2e%41. 


Example 3: Find the solution of the IVP: y” — 2y’ + 26y = 0 where 
y(0) = 1 and y’(0) = —4. 


Answer: The characteristic equation is r? — 2r + 26 = 0, and the 
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solutions of this are r = 1+ 5i and r = 1 — 5i. Using (3.21), since 
A = 1 and p =5, the general solution has the form 


y = dye! cos(5t) + doe’ sin(5t). 


To satisfy the initial conditions we need to find y’, which for our 
solution is 


y’ = (dy + 5d2)e’ cos(5t) + (—5d, + dz)e! sin(5t). 


So, to satisfy y(0) = 1 we need d; = 1, and for y/(0) = —4 we need 
d,+5dy = —4. This means that dz = —1, and therefore the solution 
of the IVP is y = e! cos(5t) — e'sin(5t). i 


Example 4: Find the solution of the IVP: y” — 9y = 0 where y(0) = —2 
and y(t) is bounded for 0 < t < oo. 


Answer: The assumption that y = e” leads to the quadratic equa- 
tion r? = 9. The solutions of this are r = —3 and r = 3. Therefore, 
a general solution is y = cje~* + c9e*. To satisfy y(0) = 1 we 
need cy + cp = —2. As for boundedness, e~*“ is a bounded function 
0 <t < o but e* is not. This means we must take cp = 0. The 
resulting solution is y= —2e-*". I 


As you might have noticed, in the above examples the formula for 
the roots in (3.10) was not used. The reason is that it is much easier 
to remember the way the characteristic equation is derived (by assuming 
y =e", etc) than by trying to remember the exact formula for the roots. 


Exercises 
1. Assuming that 2; = 1+ i, and z = e?*"S, find Re(z) and Im(z): 
a) z=2,—-8 ). gj e) 2 = 2122 


bye = 20a d) z= 21+ 42 fre (5)? 


2. Assuming 6 and y are real-valued, show that the following hold: 


<j 2 as f) ci(O+2m) _ ,i0 
te i0 
1 a—ib i(@-—p) _ € 

b = g)e = 

) a+ib a*+4+b? ee 
c) e £0, VO h) f edd = —ie” +c 

1 

dpe" = oo i) cosd= 5(e? + e#) 
e) et)? = e218 j) sin @ = x (e? es") 


Exercises 
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3. Find the general solution of the given differential equation. 


a) y +y/ — 2y =0 f) y” — 6y' + 9y =0 
b) 2y” + 3y’ — 2y =0 g) 4y”+4y’+y=0 
c) y" + 38y' =0 h) 4y"+y =0 

d) 4y"”—y=0 i) y’ —2y'+ 2y=0 
e) y” =0 j) y” + 2y' + 5y =0 


. Find the solution of the IVP. 


a) y”—y’ —2y=0, y(0) =0, y/(0) =—-1 

b) 2y” + 3y' -—2y=0, y(0) = —10, y’(0) =0 

c) y+ 3y/=0, y(0)=—-1, (0) =-1 

d) 5y”—y' =0, y(0)=—1, y'(0) =—-1 

) 38y’-—y=0, y(0) =3, y(t) is bounded for 0 < t < co 

f) y= 3y/ —y=0, y(0) =5, y(t) is bounded for 0 < t < co 
g) yy" +2y'+y=0, y(0)=—1, y’(0) =0 

h) y’+9y=0, y(0)=—1, y/(0)=—-1 

y" +2y'+5y=0, y(0)=—1, y/(0)=-1 

y’ —y' + By =0, y(0) =2,y/(0) =1 


i 


J 


. The roots of the characteristic equation are given. You are to find the 


original differential equation (of the form given in (3.17)). If only one 
value is given, that is the only root. 


=24 51 
= +21 


a) r=—-1,1 e) fS2 ey rel g) 
b) =3.5 cd) = 0.2 Lees) h) 


. Use the method of reduction of order to find a second solution y2(t), 


and then show it is linearly independent of the given solution y(t). 
a) (t+ 1)?y” —4(t+ ly’ + 6y =0, y(t) = (t+ 1)? 

b) (¢+3)y” —y' + 4(£ + 3)°y =0, y(t) = sin(¢? + 64) 

c) (t+ 1)y”—(¢+2)y +y=0, w(t) =e 


. Answer the following questions by either providing one example show- 


ing it is true, or explaining why it is not possible. 

a) Is it possible to find values for b and c so that the solution of (3.17) 
is such that limy5oy = 0, no matter what the initial conditions? 

b) Is it possible to find values for b and c so that the solution of (3.17) 
is a bounded function of t, no matter what the initial conditions? 


c) Is it possible to find values for b and c so that the solution of (3.17) 
is a periodic function of t, no matter what the initial conditions? 
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8. Suppose y(t) satisfies the IVP: y” — 2y’+2y = 0, where y(0) = —1 and 
y/(0) = 0. 
a) Without solving the IVP, determine y’’(0). 
b) Without solving the IVP, determine y/”(0), y/”(0), and y/””(0). 


c) Explain how it is possible to determine the Maclaurin series ex- 
pansion of y(t) directly from the differential equation and initial 
conditions. 


3.6 = Solution of an Inhomogeneous Equation 


We now turn to the problem of solving the inhomogeneous second-order 


differential equation 
aL ees es (3.23) 
pe gp ES INS 


As with the homogeneous equation, the first task is to explain what form 
a general solution will have. 

Equation (3.23) shares a property with all linear inhomogeneous dif- 
ferential equations. Namely, the general solution can be written as 


y(t) = Yp(t) + yr(t), (3.24) 


where y, is a particular solution of the differential equation, and yp,(t) 
is the general solution of the associated homogeneous equation. 
That the solution can be written in this way was discussed for linear 
first-order equations in Section 2.2.1. As you recall, we had solved the 
problem and then made the observation that the solution can be writ- 
ten as in (3.24). For the second-order problems we are now considering, 
the situation is reversed, and we will use (3.24) to construct the general 
solution. 

The associated homogeneous equation for (3.23) is just 

2 
< a pt +cy = 0. (3.25) 
How to find the general solution of this has been discussed in some detail, 
and formulas for the solution are given in Section 3.5. 

So, what remains is to determine how to find a particular solution of 
(3.23). As you should recall, a particular solution is any smooth function 
that satisfies the differential equation. Since any function will do, we are 
not really picky on how this function is determined. In fact, our go-to 
method is nothing more than guessing what a particular solution might 
be. For those who prefer a more systematic approach, an alternative 
method is derived in Section 3.9. The guessing method, what is called 
the method of undetermined coefficients, is considered first. 
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3.6.1 » Non-Uniqueness of a Particular Solution 


A particular solution is only required to be a solution of the differential 
equation. It is possible, for any given differential equation, to have two 
rather different looking functions both be particular solutions. As an 
example, both y = 1—t and y = 1—t+3e! — 5e~*! are particular 
solutions of y” + y/ — 2y = 4t. To explain what’s going on here, the 
general solution of the differential equation is 


y=1-ttae+oce, 
where c; and cy are arbitrary constants. A particular solution of this 
equation is a solution with particular choices for cj and cg. For the two 
particular solutions given earlier, the first has cy = cg = 0 and the second 
has cy = 3 and cp = —5. 
For the most part, when trying to find a particular solution we will 
be looking for the case of when c; = cz = 0. 


3.7 » The Method of Undetermined Coefficients 


The objective is to be able to find a solution, any solution, that satisfies 


d’y dy 

— + b— = f(t). 3.26 
Depending on f(t), it is often possible to simply guess a solution. To 
illustrate, suppose the equation to solve is 


y" ty! + 2y = 5e*. (3.27) 


This equation is asking for a function y which if you differentiate it as 
indicated and add the results together, then you get 5e®’. A function 
that will generate e* in this way is e*. In other words, it is reasonable 
to expect that a particular solution will have the form y = Ae’. Since 
y’ = 3Ae* and y” = 9Ae**, then from the differential equation we require 
that 14Ae*! = 5e**. This will hold by taking A = 5/14, and therefore a 
particular solution is yp) = ze. 
Example 1: Find a particular solution of 

y” — 2y' + y = 2cos4t. (3.28) 


Answer: The functions which will, if you differentiate them once or 
twice, generate cos(4t) are cos(4t) and sin(4t). So, the assumption 
is that a particular solution can be found of the form 


y = Acos4t + Bsin4t. (3.29) 
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Since y’ = —4Asin4t+4B cos4t, and y’ = —16A cos 4t—16B sin 4t, 
then (3.28) requires that 


(—15.4 — 8B) cos4t + (—15B + 8A) sin 4t = 2 cos 4t. (3.30) 


The respective coefficients of the cos 4¢ and sin 4¢ terms on the left 
and right hand sides must be equal. This means that: 


cos4t: —15A—8B=2 
sin4dt: —15B+8A=0 


Solving, we get that A = —30/289, and B = —16/289. Therefore, 
a particular solution of (3.28) is 


30 16 
= 4 in4t. Hf 3.31 
Up 589 ©°8 t 589 Sn (3.31) 


The key observation coming from the last example is that if you be- 
lieve a function needs to be included in the guess for yp, then all of its 
derivatives must be included. So, looking at (3.28) you would expect that 
cos(4t) needs to be part of the guess, which means you must also in- 
clude sin(4t). You do not need to include 4sin(4t), or —4 sin(4t), because 
sin(4t) is multiplied by an arbitrary constant in the guess (3.29), and this 
can account for any constant factors that might be generated by taking 
a derivative. 

There are two situations when this guessing approach runs into trou- 
ble. One is easily fixable and this is demonstrated in the next example. 
The other situation is not fixable, and the cause of the difficulty is illus- 
trated in Example 7 below. 


Example 2: Find a particular solution of 
y + 4y = 3cos 2t. 


Answer: Given what happened in the last example, you would ex- 
pect that to find a particular solution you would assume that 


y = Acos2t+ Bsin 2t. 


However, both cos 2t and sin 2t are solutions of the associated ho- 
mogeneous equation. Because of this, the guess would give us that 
y” +4y = 0, no matter what the values are for A and B. The fix is 
to take the guess, and for the terms that are solutions of the associ- 
ated homogeneous equation, multiply them by t. So, the modified 
guess for this example would be 


y = t(Acos2t + Bsin 2t). 
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To check that this works, since 
y = Acos2t + Bsin 2t + t(—2Asin 2t + 2B cos 2t), 
and 
y” = 2(—-2A sin 2t + 2B cos 2t) + t(—4A cos 2t — 4B sin 2¢), 
then from the differential equation we get 
2(—2A sin 2t + 2B cos 2t) = 3cos 2t. 


Equating the coefficients of the cos 2¢ and sin 2¢ terms we get that 
—4A =0 and 4B = 3. Therefore, A = 0, B= 3. and a particular 
solution is yp = 3¢ sin 2t. 


When using the method of undetermined coefficients, the step that 
requires the most thought is getting the guess correct. After that, it 
is relatively straightforward to find the coefficients. Consequently, in the 
examples below, only the appropriate guess is determined. In these exam- 
ples, yp(t) is the general solution of the associated homogeneous equation, 
and f(t) is the forcing function. 


Example 3: What guess should be made for y” — y! — 6y = t? + 2? 


Answer: Since f(t) = t? + 2, then f’ = 3¢?, f” = 6t, and f” = 6. 
So, a complete guess is y = At? + Bt? + Ct+ D. It remains to 
make sure that none of the functions in this guess is a solution of 
the associated homogeneous equation. Since yp, = cye* + coe~%, 
and the guess does not include e* or e~?!, then our guess is, indeed, 


complete. MH 


Example 4: What guess should be made for y’ — y! — 6y = te~™"? 


Answer: The initial guess is y = Ate~°'. However, y! = A( 


5te-°‘), and this includes a new function e~*’. This must be in- 
cluded in the guess, and so a complete guess is y = Ate~*! + Be~*’. 
Finally, since yp, = ce®! + c2e~7", and the guess does not include e*¢ 
or e~?", then our guess is, indeed, complete. Ml 


et = 


Example 5: What guess should be made for y” — y’ — 6y = 4t? +1 — 
sin(at)? 
The guess for f(t) = 4#? + 1 is y = Aot? + Ajt + Ag, and the guess 
for f(t) = sin(at) is y = Bosinat + B, coszt. So, for the equation 
as given, a guess is 
y= Aot? + Ait + Ao + Bosin xt + B, cos zt. 
Finally, since yp, = cje*’ + c2e~*", and the guess does not include e** 
or e~*', then our guess is, indeed, complete. Mi 
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if f(t) contains then y,(t) contains all of the following 
et ett 
cos(wt) or sin(wt) cos(wt), sin(wt) 
i Pee 
trent trert tr—leat pike eat 
o] ? o] 
e” cos(wt) or e” sin(wt) e* cos(wt), e% sin(wt) 


Table 3.1. Guesses when using the method of undetermined coefficients. Note 
that the exponent n must be a non-negative integer. Also, adjustments are needed if 
Yp(t) contains a solution of the associated homogeneous equation (see Examples 2 and 
6 in Section 3.7, and Example 3 in Section 3.8). 


Example 6: What guess should be made for y” + 4y’ + 4y = 5e77!? 


Answer: The initial guess is y = Ae~?’. However, for this equation, 
yn = cie 7 + cote?" and one of these functions appears in the 
guess. The first modification y = Ate~?! also appears in y,, and 
this means we need to multiply by ¢t again. Therefore, the complete 
guess is y= At?e"**. 


Example 7: What guess should you make if f(t) = In(1 + t)? 


Answer: The initial guess is y = Aln(1 +t). Its derivatives are 
y = A/t+y), y’ = -—A/1+y), y” = 2A/(1+ 8), etc. Unlike 
the other examples, the list of different derivative functions does not 
stop. In such cases, the method of undetermined coefficients should 
not be used. So, the answer to the question is, there is no guess and 
the method described in Section 3.9 should be used. Hf 


In Example 1, we ended up with the equation 
(—15.4 — 8B) cos4t + (—15B + 8A) sin4t = 2cos4t, Vé>0. (3.32) 


To find A and B we equated the coefficients of the cos 4t and sin 4t terms 
in this equation. This can be done because these functions are linearly 
independent. However, this approach does not require that you prove the 
functions are independent. Rather, if you think they might be, and you 
then determine values for A and B so (3.32) is satisfied based on this 
assumption, then you have found a particular solution. 
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3.7.1 » Summary Table 


Most textbooks on differential equations have a table for various guesses 
that you should make for the method of undetermined coefficients. It is 
much easier to just remember the rules used in formulate the guess, and 
the earlier examples should be reviewed for the particulars. However, 
some do find a table useful, and one is provided in Table 3.1. A few 
comments need to be made about what is listed. First, if f(t) contains 
t”, as well as t”~!, or t”~?, or t”~?, etc, then the guess for t” is all that you 
need (see Example 5 above, or Example 1 in the next section). Second, 
when solving (3.8), if one the functions in the left column is a solution 
of the associated homogeneous differential equation the guess must be 
modified. The needed modification was explained earlier (see Examples 
2 and 6 above, or Example 3 in the next section). 


3.8 = Solving an Inhomogeneous Equation 


As stated earlier, the general solution of 


d’y dy 
7p eae f(t), (3.33) 
can be written as 
y(t) = yp(t) + yn(t), (3.34) 


where yp is a particular solution, and yp, is the general solution of the 
associated homogeneous equation. We now know how to find y, and yp, 
and so we consider a few examples. 


Example 1: Find a general solution of y” — 3y! + 2y = 5t? — 3. 


Step 1: Find y,. The associated homogeneous equation is y” — 
3y’+2y = 0. Assuming y = e”’, one gets the characteristic equation 
r? — 3r +2 = 0. The roots are r = 1 and r = 2, and so y, = 


Step 2: Find yp). The guess is y = At? + Bt + C, which means 
that y’ = 2At+ B and y” = 2A. Inserting these into the differential 
equation we get that 


DAY (6A + 2B)t+ 2A = 3B +90 = 5 =3. 


The coefficients of the respective t” terms on the left and right hand 
sides must be equal. This means that: 


t?: QA=5 
i —6A+2B=0 
9: 2A—-3B4+2C =-3 
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Solving, we get that A = 5/2, B= 15/2, and C = 29/4. 
Step 3: The general solution is 
5.9 15 


29 
y=5t ++ 5 tl aI Leper as coe: | 


Example 2: Find the solution of the IVP: y” — 4y/+5y = 10—e* where 
y(0) = 3/2 and y/(0) = 0. 


Step 1: Find y;. The associated homogeneous equation is 7’ — 
Ay’ +5y = 0. Assuming y = e”, one gets the characteristic equation 
r? —4r+5=0. The roots are r = 2+i, and so yp, = cye** cost + 


coe” sin t. 


Step 2: Find y,. The guess is y = A+ Be*, which means that 
y = 3Be* and y” = 9Be*. Inserting these into the differential 
equation we get that 


2Be* +5A =10—e*. 


Equating the coefficients of the respective functions, 2B = —1 and 
5A = 10. Solving, we get that A = 2 and B = —1/2. 

Step 3: The general solution is y = 2— seu +ce*! cos t+cge” sin t. 
Step 4: To satisfy y(0) = 3/2 we need 3/2+c, = 3/2, soc, = 0. For 
y' (0) = 0 we need —3/2 + cg = 0, giving cz = 3/2. The conclusion 
is that the solution of the IVP is 


1 3 
y=2-— Be + ao sint. 


Example 3: Find a general solution of y” — 2y! = —3t?. 


Step 1: Find y,. The associated homogeneous equation is y” — 
2y’ = 0. Assuming y = e”, one gets the characteristic equation 


r? —2r =0. The roots are r = 0 and r = 2, and so yp, = cy + cne”". 


Step 2: Find y,. The initial guess is y = At?+Bt+C. However, one 
of the terms in this guess is a solution of the homogeneous equation, 
and so the guess must be modified to y = ¢(At?+ Bt+C). Inserting 
this into the differential equation we get that 


6At + 2B — 2(3At? + 2Bt+ C) = —32”. 


Equating the coefficients of the respective powers of t, we get that 
6A = —3, 6A—4B = 0, and 2B—2C = 0. Solving yields A = 1/2, 
B=3/4;and C=3/4, 


Step 3: The general solution is therefore 


1 
y= qt (at? +3t+3)+e+cc%. Ef 
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Exercises 


1. Find a particular solution of the given differential equation. 


a) y — y! — 6y = bet i) y! — Qy! + by = 5t2 +4 
b) y” + 3y’ + 2y = sinat j) oy” + 2y' + 10y = 3e8 +1 
c) yf” + 4y!' — Sy = 25¢? k) y” —3y =9 —6 
d) 5y"” — y! =e"! + 3cos 2t 1) 3y” + y! — 2y = 12e~%t — 2e¢ 
e) — 5y’ — 2y = 8t? — 16t ay " _ 8y 4. 17y = e* sint 
f) 8 2y —y=44 65sin2¢ n) y” — 5y’ — 6y = —6sin(t + 7) 
g) yy = te 0) y + 3y! + 2y = 20sin? t 
h) y” — 5y’ — 6y = 30t sin(3t) p) 4y” + y’ = 65 sin(t) cos(t) 


2. Find the general solution of the given differential equation from Exer- 
cise 1. 


3. Find the solution of the given IVP. 
a) y +y' — 2y = 12t, y(0) = 0, y/(0) =0 
b) yl + 4y = 827, y(0) = 1, y/(0) =0 
c) y’ —y' = 2sint, y(0) = 1, y/(0) = -2 
d) y" + 3y' = 9t, y(0) = 1, (0) =0 


e) y” + 4y' + 4y = 4e*, (0) = 0, /(0) = 0 
f) 4y” —y = 4e-#? +1, y(0) = 1, y/(0) = -1 
)=1, y'(0) =4 


g) y’ +9y = -6 ee) y(0 
h) y” + 2y' + 5y = 4e~*, y(0) = 2, y’/(0) = 0 
i) 2y” — 2y'+y =5cost, y(0) = —1, y/(0) = -1 


4. For the following, determine a complete guess that can be used to find 
a particular solution (you do not need to find the coefficients). 


a) yy’ +y —-2 =P - 2 f) y” +y/ + 2y = te 
b) y” + 4y = tcost g) y” —y' + 6y =e * cos 3t 
c) ake: ceed coe h) 5 ae a 
d) y’—y' =1+sint i) y —2y! + 2y =e cost 
e) y+ 3y =1t+e% j) y” + 4y = cos(2t + 3) 


5. The idea underlying undetermined coefficients has nothing to do with 
the differential equation being second-order. What is required is a 
linear differential equation with constant coefficients. As an example, 
for the first-order equation y’ + y = e?", the associated homogeneous 
equation is y/ + y= 0. So, y, = ce‘. A particular solution is found 
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by assuming that y = Ae’, from which one gets A = 1/3. The general 
solution is therefore y = ze" +ce~'. Finding the solution in this way 
is easier than using an integrating factor (which is the way it is done in 
Example 1 of Section 2.2). Find the general solution of the following 
first-order equations using the method of undetermined coefficients. 


a) y! — 6y = 2e? e) y’ — 4y = 10tsin 2t 

b) 3y’ + 2y = sinzt f) y’ — 6y = 14te-* + 2 
c) y’ + 3y = 2t g) 3y’ +2y =e‘ cos(t) 
d) 5y’-—y=e'+3t h) y’ — 2y = cos(2t + 5) 


3.9 » Variation of Parameters 


When the method of undetermined coefficients works, it is relatively easy 
to use it to find a particular solution. However, as illustrated in Example 
7 of Section 3.7, it does not always work. In such cases, the method of 
variation of parameters can be used. Interestingly, this method is also 
based on a guess. Namely, to find a particular solution of 


d’y dy 
it is assumed that 
y = ur(t)yi(t) + ua(t)ya(t), (3.36) 


where y; and yo are independent solutions of the associated homogeneous 
equation. As you should notice, the guess (3.36) resembles the general 
solution of the associated homogeneous equation. However, instead of 
arbitrary constants, there are now unknown functions wu; and ug. Our job 
is to find these functions. Although it might not appear to be significant 
right now, we are looking for a single function, yp», yet our guess contains 
two unknown functions. This means that we have the option to pick 
one of these two functions anyway we wish. We will use this option to 
advantage to find yp. 

Our task is simple in that (3.36) must be a solution of (3.35). So, in 
preparation for substituting (3.36) into (3.35) note that 


y = uly tury} + ugye + uryd. 


We now use the option of picking u, or ug anyway we want. The specific 
choice is that 
uy + Udye = 0. (3.37) 


So y! = uy, + ways, and y” = uy + uly, + ueys + uby. Substituting 
these into (3.35), we get that 


uy, + ugyy + ur(yt + by, + cy1) + uo(ys + bys + cy) =f. (3.38) 
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Using the fact that y, and yo are solutions of the associated homogeneous 
equation, then the above equation reduces to 


uy, + ugyy = f. (3.39) 


Therefore, to find u; and ug, we must solve (3.37) and (3.39). This is 
fairly easy. First, from (3.37), u4 = —u/yi/y2. Inserting this into (3.39) 
we get that 


(yoy, — yiya)uy = yet. 
This can be written as 


—W(y1, y2)u, = yf, 


where W(y1, y2) is the Wronskian as defined in (3.6). Solving this gives 


us that . (5) f(s) 
Y2\s) Js 

uy(t) = ds. 3.40 

0 = | Weal ey 

Inserting this into ul = —uy1/y2., and integrating, we obtain 
t 

yi(s) f(s) 

uo(t) = ds. 3.41 

= Pent) an os 


The integration constants have not been included in (3.40) and (3.41) as 
we are looking for a particular solution (versus the general solution of the 
equation). 

Therefore, the particular solution we have found is 


(5) f(s) ()Ff(8)__ a, 


_ ie as : ‘oy 
Yp(t) = nt) [ ECHO ONG + utd f W (yr(s), yo(s)) ip) 


Example 1: Find a particular solution of y/’ — 3y/ + 2y = t using varia- 
tion of parameters. 


Step 1: Find y; and yo. The associated homogeneous equation is 
y” — 3y’ + 2y = 0. Assuming y = e™, one gets the characteristic 


equation r? — 3r +2 = 0. The roots are r = 1 and r = 2, and so 


y1 =e! and yo = e”. 


Step 2: Find u;. Since W = yy), — yoy, = e®, and f = t, then 
2 1 


from (3.40), 
t 32s t 
u(t) = i — ds = | se “ds. 
0 © 0 


Using integration by parts yields uj = (1+ t)e* — 1. 
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Step 3: Find ug. From (3.41), and using integration by parts, 
t us t 
e°s 1 
t)= | =-ds= ~*8ds = —[1 — (2t+ 1)e**]. 
u2(t) / wae 48 / se 8 ma (2¢ + 1)e"*"| 
Step 4: Collecting our results, 


up = [(L+ ee*— leh + it — (2t + 1e~**]e* 


3.9.1 » The Solution of an IVP 


It is not hard to show that y,(t), given in (3.42), satisfies y,(0) = 0 and 
y},(0) = 0. Therefore, the solution of the IVP 


d’y dy 
qe toy toy =F): 


where y(0) = yo and y'(0) = yp, is 
y(t) = cryi(t) + coya(t) + y(t), (3.43) 


where c; and cz are found by solving 


c1yi(0) + c2y2(0) = yo 
cry; (0) + coys(0) = yp. (3.45) 


It needs to be remembered that y,(t) appearing in (3.43) is the particular 
solution given in (3.42). 


Example 2: Find the solution of the IVP: y”+4y = Vt, where y(0) = 1, 
and y’(0) = 0. 


Step 1: Find y; and yo. The associated homogeneous equation is 
y" +4y = 0. Assuming y = e”, one gets the characteristic equation 


r? = —4. The roots are r = +2i, and so y, = cos 2t and y = sin 2t. 
Step 2: Find u,. Since W = yyh — yoy, = 2, and f = Vt, then 
from (3.40), 


in (t) = af 5VSsin(2s)ds. 


The answer is left as a definite integral because it is not possible to 
express it in terms of elementary functions. 


Step 3: Find ug. From (3.41), 


w(t) =f 5/8 eos(2s)ds 
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Step 4: Solve (3.44) and (3.45). One finds that c; = 1 and cg = 0. 
Step 5: Therefore, from (3.42) and (3.43), the solution is 


y = cos(2t) + ; i Vs| sin(2t) cos(2s) — cos(2t) sin(2s)| ds 


= cos(2t) + a Vssin (2(t—s))ds. & 


A couple of comments need to be made about (3.43). First, it is the 
solution of the IVP, irrespective of what continuous function f(t) is used. 
It can also be adapted so it is the solution for more general problems 
(see Exercise 3). A drawback is that it can require more work to find 
the solution. As a case in point, it is much easier to do Example 1 
using undetermined coefficients. However, for Example 2, undetermined 
coefficients does not work, and this means that (3.43) is the method of 
choice. The recommendation is to first consider whether undetermined 
coefficients can be used, as it is usually fairly simple to carry out. It 
also has the advantage that it is easier to remember than the variation of 
parameters formula. 


Exercises 


1. Using variation of parameters, find a particular solution of the given 
differential equation. 


a) 2y” + 3y/ — 2y = 25e7# d) y” + 3y = 317/? +9 
b) yf" —2y! + 2y =6 e) By" =a 
c) y’ +y/ —2y = 3n(1 +4) f) dy” — y = 4sin(1 + ¢?) 


2. Find the solution of the IVP where the differential equation comes 
from the previous problem, and the initial conditions are y(0) = 1 and 


y'(0) =0. 


3. The formula for a particular solution given in (3.42) applies to the more 
general problem of solving y”+p(t)y’+q(t)y = f(t). In this case, y,; and 
yg are independent solutions of the associated homogeneous equation 
y" + p(t)y’ + q(t)y = 0. In the following, show that y; and yz satisfy 
the associated homogeneous equation, and then determine a particular 
solution of the inhomogeneous equation. 


a) ty” —t(t+2)y + (¢+2)y = 208; y(t) =t, yo(t) = te? 
b) ty” —(t+ ly +y=e*; y(t) =1+t, p(t) =e 
c) ty" — 3ty! + 4y = 0/2; y(t) =0, w(t) =? lnt 
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4. The Bessel equation of order p is t?y" + ty’ + (t? — p?)y = 0. In this 
problem assume that p = 5: 
a) Show that y, = sint//t and y2 = cost/ Vt are linearly independent 
solutions for 0 < t < oo. 
b) Use the result from part (a), and the preamble in Exercise 3, to find 
a particular solution of t?y” + ty! + (t? — 1/4)y = t?/? cost. 


3.10 = Linear Oscillator 


We are now going to consider the problem that comes from the mass, 
spring, and dashpot illustrated in Figure 3.1. The differential equation is 


mu” + cu’ +ku=0, (3.46) 


where u(t) is the displacement of the mass from its rest position, with 
positive in the upward direction. In this case, the velocity of the mass is 
v =u’, and its acceleration is a = u”. 

The physical interpretation of the terms in (3.46), and the basic prop- 
erties of the solution, are described in the following pages. 


Figure 3.1. Mass-spring-dashpot system. 


3.10.1 » The Spring Constant 


To begin, a spring of length @ is suspended as illustrated in Figure 3.2. 
An object with mass m is then attached, which stretches the spring a 
distance L. The forces on the object in this case are gravity, Fj, and 
the restoring force from the spring, Ff. The gravitational force is just 
F, = —mg, where g is the gravitational acceleration constant. The spring 
force is determined using Hooke’s law, which states that the restoring 
force is proportional to how much the spring is stretched. To translate 
this into a mathematical formula, according to Hooke’s law, F; = kL, 
where k is the proportionally constant known as the spring constant. 
The total force on the mass is F = F, + Fy. According to Newton’s 
second law, F = ma. Since the mass is at rest (so, a = u” = 0), we get 


that PF, + Fy = 0. From this we obtain 
mg 
= A 
T (3.47) 


So, by measuring L, we can determine k from the above formula. 
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Figure 3.2. Left: The original spring. Middle: The situation after the mass 
is attached, and at rest. Right: Displacement u(t) of the mass from its rest position. 


3.10.2 » Simple Harmonic Motion 


Now, with the mass attached, we set it in motion. For example, as il- 
lustrated in Figure 3.2, the mass is pushed up and then released. The 
equation governing the motion is, again, determined from Newton’s sec- 
ond law. As before, the gravitational force is F, = —mg. From Hooke’s 
law, the restoring force due to the spring is F, = k(L — u), where u(t) is 
the displacement of the mass from its rest position. Since F' = ma, and 
the force in this problem is F = F, + F, we get the following differential 
equation 

mu” + ku = 0. (3.48) 


To find the general solution of (3.48), from the assumption that u = e” 


the characteristic equation is found to be mr? +k = 0. This produces the 


roots r = twoi, where 
k 
= 4/—. 3.49 
wo == (3.49) 


From (3.22), the general solution can be written as 


u = Reos(wot — ¢), (3.50) 


where R > 0. This periodic function corresponds to what is called simple 
harmonic motion. In this context, the coefficient R is the amplitude, 
wo is the natural frequency, and the period is T = 27/wo. The argu- 
ment 0 = wot — y of the cosine is called the phase, and —y is the phase 
shift, or the phase constant. 

In terms of initial conditions, it is usual to specify the initial displace- 
ment and the initial velocity. Together, these correspond to 


u(0)=uo, and u'(0) =u9, (3.51) 
where ug and up are given. To satisfy these, from (3.50), we get that 


Rcos(~) = uo, (3.52) 


Rsin(y) = —. (3.53) 
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w(0)/wo 


Figure 3.3. The initial conditions as expressed in (3.52) and (8.53), located 
using the black dot, and the value of R and yp. 


Finding R: Using the identity cos?(y) + sin?(y) = 1, it follows that 


R=4/uz+ (*2)", (3.54) 


Finding y: The value for y depends on whether up and wp are positive 
or negative, as illustrated in Figure 3.3. Because sin@ and cos@ are 
27-periodic, the value for y is not unique. Usually we will use the 
value that satisfies —7 < yp < a. So, from Figure 3.3, if uo = 0 
and up > 0, then y = 7/2. Similarly, if up = 0 and up < 0, then 
y = —71/2. In the case of when uo 4 0, you can take the ratio of 
(3.53) with (3.52) to obtain 

Uo 


tan(y) = wig 7 


The principal value of the arctan function is denoted as Arctan, and it 
satisfies —> < Arctan(s) < >. This is the value most calculators, or 
programs like MATLAB or Python, give when evaluating arctan(s). 
So, setting s = ug/(wouo), the resulting value of y is shown in Figure 
3.4. For example, if uo > 0, then y = Arctan(s), and if uo < 0 and 


Up > 0, then y = Arctan(s) + 7. 


ul(0)/wo 


y = Arctan(s) + 7 | y = Arctan(s) 


> 
u(0) 
y = Arctan(s) — «| y = Arctan(s) 


Figure 3.4. The value of y using the principal value of the arctan function, 
where s = ug/(wouo). 
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Figure 3.5. Simple harmonic motion solution for Example 1. 


Example 1: A 9kg mass is attached to a spring, stretching it “ m. The 
mass is then set into motion by pulling it down 2m and releasing it with 
an upward velocity of 1m/s. Assume that g = 10m/s?. 


Question 1: What is the value of the spring constant? 
Answer: Since m = 9kg and L = +m, then from (3.47) we get 


that k = 81kg/s? . 


Question 2: Find the resulting simple harmonic motion, and then sketch 
the solution. 
Answer: The initial conditions are u(0) = —2, and u’(0) = 1. Also, 
from (3.49), wo = 3, and this means, using (3.50), that the general 
solution is u = Rceos(3t — vy). From (3.54), the amplitude is R = 
/37/3. As for y, from Figure 3.4, g = Arctan(—1/6) + 7. The 
resulting solution is shown in Figure 3.5. In this case, the period is 
VP =]99 fag = 20/3: 


Question 3: When is the first time that u(t) = R? 
Answer: The solution is u = Rcos 6, where the phase is 0 = 3t — y. 
Given that 7/2 < y < 7, the linear function 6(t) is shown in Figure 
3.6. Now, cos@ = 1 when 6 = 0, +27,+47,---. According to Figure 
3.6, for t > 0, the first possible value is 6 = 0 and this occurs when 
t = y/3. This is labeled as t; in Figure 3.5. 1 


pA 


—n/2t 


—T + 


Figure 3.6. Phase function 0 for Example 1. 
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It is worth mentioning that the curve in Figure 3.5 can be sketched 
just knowing the initial conditions. The reason is that the solution of a 
simple harmonic motion problem is just a cosine curve that has amplitude 
R. So, in Figure 3.5 the solution starts at uw = —2 and has a positive slope 
since u/(0) = 1. The curve then oscillates between the lines u = R and 
u = —R, where R is known from the initial conditions. What you do not 
know is the period T. In fact, as shown in (3.49), the natural frequency, 
and therefore the period, are independent of the initial conditions. 


3.10.3 « Damping 


We will now include a damping mechanism. It is assumed that the damp- 
ing force is proportional to the velocity. For the mass-spring system the 
resistance is usually illustrated as a dashpot, as shown in Figure 3.1. Ir- 
respective of exactly what mechanism is involved, the result is that the 
damping force is Fy = —cv, where v = uw’ is the velocity, and c is the 
damping constant and it is non-negative. From the equation F’' = ma, 
and the fact that F = F, + Fy + Fa, the resulting differential equation is 


mu” + cu’ + ku=0. (3.55) 
Finding the general solution is straightforward. Assuming u = e”, 


then the resulting characteristic equation is mr? + cr + k = 0. The roots 


r= | —ctVce?- 4k). (3.56) 


Im 


Just as in Section 3.5, there are three cases to consider. The only differ- 
ence now is that certain terminology is introduced to identity the cases. 


Over-damped: This means that the damping constant is large enough 
that c? > 4mk. In this case both roots are real-valued, and the resulting 
general solution is 

u = cye™ + eye", (3.57) 


where 7] = 5 ( e+ Vc? 4mk) and rz = s+ ( c— Vee 4mk). It 
is worth noting that the roots are both negative. Therefore, no matter 
what the initial conditions, 


lim u = 0. (3.58) 

too 
Critically damped: This means that the damping constant has just 
that right value that c? = 4mk. So, there is one root, and the resulting 


general solution is 
u = (ce, + cate", (3.59) 


where r = —c/(2m). So, as for the previous case, no matter what the 
initial conditions, (3.58) holds. 
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Figure 3.7. Response of a damped mass-spring system, depending on the 
strength of damping that is present. The dashed red curves in the two lower graphs are 
the functions +Re™, where \ = —c/(2m). 


Under-damped: This means that the damping constant is small enough 
that c? < 4mk. The roots are complex-valued, and the resulting general 


solution is 
u = Re cos(ut — ¢), 


(3.60) 


where \ = —c/(2m), and p = V4mk — c?/(2m). The solution is not 
periodic, but it is oscillatory with an amplitude Re™ that decays to 
zero (assuming, of course, that c > 0). Consequently, no matter what 


the initial conditions, (3.58) holds. 


One conclusion coming from the above discussion is that because of 
damping, no matter what the initial conditions, the solution decays ex- 
ponentially to zero. The role of damping, and how it affects the solution, 


is explored in the next examples. 


Example 2: For a mass-spring-dashpot system, 


suppose that m = 2, 


k = 1, and c=1. Also, assume that the initial conditions are u(0) = 1, 


and u’(0) = 2. 


Question 1: What is the solution? 
Answer: From (3.56), the roots are r = (—1 


+ iv/7)/4. So, this is a 
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case of under-damping, with A = —1/4 and p = /7/4. From (3.60), 
the general solution is 


u= Re t/4 cos( v7 — e). (3.61) 


To satisfy the initial conditions, we need Rcosy = 1, and Rsiny = 
9/./7. From this we get that R = 2,/22/7, and y = Arctan(9/V/7). 


Question 2: Sketch the solution. 


Answer: From (3.61), we know that the solution oscillates between 
Re-*/* and —Re~*/*. These are the red dashed curves in Figure 3.7 
(the under-damped plot). Since u’(0) > 0, then the solution starts 
out at u(0) = 1, and moves upward. From that point on it simply 
bounces back and forth between the red dashed curves. 


Question 3: When is the first time that u(t) = 0? 


Answer: Writing the solution as u = Re~‘/* cos 6, the phase func- 


tion is 6 = svi7t — y. Sketching this as in Figure 3.6, but now with 
0<y< 7/2, it is seen that the first time cos 0 = 0 is when 0 = 7/2. 
Consequently, t = 2[7 + 2Arctan(9/V7)|/V7. 


Example 3: For a given mass-spring-dashpot system, how does the so- 


lution change as the damping coefficient changes? 


Answer: Taking m = 2, k = 1, then r = (—c+ vc? —8)/4. Us- 
ing the initial conditions u(0) = 1, and u’/(0) = 2, the resulting 
solution is shown in Figure 3.7, for different values for the damp- 
ing constant. The values used give rise to: over-damping (c = 6), 
critically damped (c = V2), under-damped (ec = 1), and weakly 
damped (c = 1/40). To say it is weakly damped means that it 
is under-damped, and c is so small that the solution resembles the 
periodic solution of an undamped oscillator, at least at the begin- 
ning. Eventually, the damping does reduce the amplitude enough 
to be noticeable. 


For over-damping, and critical damping, except near the beginning, 
the solution simply decays monotonically to zero. In comparison, 
for both under-damped cases the solution oscillates as it decays to 
zero. In both cases the solution bounces back and forth between 
the two dashed red curves, which are just the functions Re*™’ and 
—Re. 


3.10.4 » Forced Motion and Resonance 


It is often the case that the mass is subjected to an external force f(t). 
This would arise, for example if someone was pushing on the mass, similar 
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to what happens when you push someone in a swing. In this case, the 
total force is F = F,+F,+Fa+ f(t), and the resulting differential equation 
is 

mu” + cu’ +ku= f(t). (3.62) 


Of particular interest is the case of when the forcing is periodic and 
there is no damping (so, c= 0). The specific equation to solve is 


mu" + ku = Fo coswt, (3.63) 


where w is the driving frequency, and Fo is the amplitude, of the forcing 
(both w and Fo are positive). Assuming u(0) = u’(0) = 0, the resulting 
solution is 


Fi 
Fs ( costwt) — cos(wot))), if w #wo, 
uU= z (3.64) 
0 


2Vkm 


where wo is given in (3.49). 

What is of interest here is that, when the system is driven at its 
natural frequency wo, the solution is an oscillatory function whose ampli- 
tude Fot/(2Vkm) becomes unbounded as t increases. This happens even 
though the amplitude of the forcing is constant. This is an example of 
what is called resonance. An example of a resonant solution is shown in 
Figure 3.8(upper). 

Resonance is a particularly important phenomena in science and en- 
gineering, and it is often something that is to be avoided. As an example, 


tsin(wot), if w= Wo; 


12F ————— Se ——— — — = —— 
S 
= 0 
be Pe [SSS SS ee eas ao = = os = 
0 100 200 300 400 


Figure 3.8. Upper: Resonant solution given in (3.64) when w = wo = 1/3, 
Fo = 1, m=9 andk =1. The red dashed lines correspond to +Fot/(2Vkm). Lower: 
Solution when a dashpot, with c= 1/4, is included. The red dashed lines correspond to 
+R, where R is given in (8.66). 
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a wing on an airplane can go into a flapping motion. This can be mod- 
eled as a forced simple harmonic oscillator, and under certain conditions 
the wing can start to go into resonance. This is known as flutter, and 
the resulting large oscillations can lead to the wing breaking off (which 
can be upsetting to those in the airplane). What is a concern is that 
this will happen no matter what the value of Fo, as long as it’s nonzero. 
So, even a very small force, what would normally be considered to be 
inconsequential, can lead to extremely large oscillations. 


Stopping Resonance 


One way to avoid resonance is to include a damping mechanism in the 
system. With the dashpot we introduced earlier, the equation to solve is 


mu” + cu! + ku = Focoswt. (3.65) 


The forcing no longer contains a solution of the associated homogeneous 
equation, and so resonance will not occur. However, it is often the case 
that the damping is weak. This means that if w = wo, then the solution 
will start out like it’s going into resonance, but eventually the damping 
will stop this. An example of what happens is shown in Figure 3.8, lower. 

This brings us to the question to be considered. Using the flutter 
example, the question is: we don’t want the wings to break off, so just 
how large do the oscillations get before the damping stops this? To an- 
swer this, it is the particular solution that is responsible for the growing 
oscillations. So, for the weakly damped case we are considering, only the 
particular solution is considered. To find the particular solution of (3.65), 
the assumption that u = Acoswt+ Bsinwt leads to the requirement that 
A and B satisfy 


m(we — w*)A+ cewB = Fo, 


cewA + m(we — w?)B=0. 


From this one obtains 


m(we — w*) cw 


A = FEF, — 
cfu? + m? (we —w?)? m C2? + m? (we — w?)? 


iB, 


Now, to determine the amplitude of the resulting oscillation, it makes 
things easier to write the solution in the form u = Rcos(wt — vy). This 
requires that Rcosy = A and Rsiny = B, and therefore 


1 
R=VA4+B2= Fo. (3.66) 


Vw? + m2 (we — w?)? 


The amplitude R is plotted in Figure 3.9 as a function of the driving 
frequency w in the particular case of when Fo = 1, m = 1, and k = 1/2. 
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Figure 3.9. The amplitude (3.66) of the forced, but damped, oscillator, as a 
function of the driving frequency. Note that wo is the natural frequency of the undamped 
oscillator. 


What is seen is that the smaller the damping coefficient c, the more peaked 
the response becomes. Also, the peak response occurs at a frequency 
smaller than the natural frequency wo, but this difference decreases as c 
is reduced. 


Our flutter question is answered by determining what driving fre- 
quency w gives the largest value for R. Taking the derivative of R with 
respect to w, and setting it to zero gives us that w = wy, where 


wo = we — w2 (3.67) 
and w. = c/(V2m). The resulting maximum for R is therefore 


Fo. (3.68) 


Now, suppose that for the flutter problem it is found experimentally that 
the wings won’t break off if the amplitude of the oscillation satisfies R < 
Rp». Based on our calculations, this means that the damping coefficient c 
must be large enough that Ray < Rp. 


Reality Check: The resonance phenomena considered here is not possible 
for the mass-spring system envisioned in Figure 3.2. As the oscillations 
grow, as predicted by (3.64), they will eventually get to the point that 
the mass will start banging up against the upper support. Presumably, 
as the amplitude grows, our linear model is no longer valid, and a more 
physically realistic, nonlinear, model is necessary. Even so, the linear 
model is useful as it provides information about the onset of resonance. 


Units and Values: In the exercises, the value to use for g is usually stated. 
If it is not given, then you should leave g unevaluated. Whatever value is 
used, it is only approximate. If a more physically realistic value is needed, 
then you should probably use the Somigliana equation. Finally, weight 
is a force, so for an object that weighs w lbs, its mass can be determined 
from the equation w = mg. 
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Exercises 


In answering the following questions, do not numerically evaluate numbers 
such as V2, 7/3, e?, In(4/3), etc. The exception to this is when the 
question explicitly asks you to compute the answer. 


1. 


Write the following in the form u = Rcos(wot — y). 
a) u=cos 3t + sin 3t c) u=-3 3cost + sint 
b) u= V3coszt — sin zt d) u = —4 cos 2t — 4sin 2t 


. Assuming u = Rcos(wot — vy), you are to use the given initial condi- 


tions to determine R and y. You can assume that wo = 1. 


a) w(0) = 0, uw (0) = 2 d) u(0) = —2, u’(0) = —2 
b) u(0) = 0, u’(0) = —2 e) u(0) = 1, u’(0) = -V3 
c) u(0) = 2, u’(0) = 2 f) u(0) = —1, u/(0) = V3 


. You are to sketch the simple harmonic oscillator curve that has the 


following initial conditions. Make sure to state the value of R (the 
value of T is not determinable from the information given). 


a) u(0) = 2, u’(0) = -1 c) u(0) = 1, u’(0) =0 
b) u(0) = 0, u’(0) = —2 d) u(0) = —2, u/(0) = —2 


. A block weighing 2b stretches a spring 6 in. Assume that the mass 


is pulled down an additional 3in and then released from rest. Assume 
that g = 32 ft/s?. 

a) What IVP does u(t) satisfy? 

b) What is the solution of the TVP? 

c) What is the natural frequency, period, and amplitude of the motion? 
d) Sketch the solution for 0 <t < 37. 


e) Is the restoring force in the spring ever zero? What is the minimum 
value of the force in the spring? 


. A mass of 100gm stretches a spring 2 m. Assume that the mass is 


pulled down a distance of 1m, and then set in motion with an upward 
velocity of 2m/s. Assume that g = 10 m/s?. 

a) What IVP does u(t) satisfy? 

b) What is the solution of the IVP? 

c) What is the natural frequency, period, and amplitude of the motion? 
d) When does the mass first return to its steady state position? 

e) Sketch the solution for 0 <¢t < 37. 

f) What is the first time the force F' is zero? 


Exercises 


6. 
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A mass of lkg stretches a spring 10cm. Assume that the mass is 
pushed upward a distance of 5cm, and then set in motion with a 
downward velocity of 50cm/s. Assume that g = 10 m/s?. 

a) What IVP does u(t) satisfy? 

b) What is the solution of the IVP? 

c) What is the natural frequency, period, and amplitude of the motion? 
d) Sketch the solution for 0 < t < 3T. 


e) What is the largest value of the restoring force in the spring? When 
is the first time it equals this value? 


. According to Archimedes’ principle, an object that is completely or 


partially submerged in water is acted on by an upward (buoyant) force 
equal to the weight of the displaced water. You are to use this for 
the following situation: A cubic block of wood, with side 1 and mass 
density p, is floating in water. If the block is slightly depressed and then 
released, it oscillates in the vertical direction. Derive the differential 
equation of motion and determine the period of the motion. In doing 
this let 9 be the mass density of the water, and assume that po > p. 


. In a mass-spring system, suppose the mass is pulled down a distance 


d and released from rest. 


a) If the resulting natural frequency is 10s~! when d = 0.1m, what is 
the natural frequency when d = 0.2m? 

b) Suppose the amplitude of the motion is 0.1m. Is it possible to 
change the initial velocity, keeping d unchanged, so the amplitude 
of the motion is 0.2m? 

c) Suppose the natural frequency is 10s-' when d = 0.1m. Is it 
possible to change the initial velocity, keeping d unchanged, so the 
natural frequency is 20s~'? 


Damping 


9. 


10. 


A block weighing 161b stretches a spring 6in. The mass is attached 
to a viscous damper with a damping constant of 2lbs-s/ft. Assume 
that the mass is set in motion from its equilibrium position with a 
downward velocity of 4in/s. Also, assume that g = 32 ft/s?. 

a) What IVP does u(t) satisfy? 

b) What is the solution of the IVP? 

c) Sketch the solution for 0 < t < mV15/5. 

d) What is the largest value of u(t)? 


Suppose you construct a mass-spring-dashpot system as shown in Fig- 
ure 3.1. In this problem assume that g = 10m/s?. 
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12. 


13. 
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a) If the spring is stretched + m by a force of $N, what is the spring 
constant? 

b) If the dashpot exerts a force of —3N when the velocity is 1m/s, 
what is the damping constant? 

c) Suppose the mass is 5 kg, and it is pulled up 1m from its rest 
position and given an initial downward velocity of 2m/s. What 
IVP does u(t) satisfy? 

d) What is the solution of the IVP? 

e) Sketch the solution for 0 < t < 107. 


The general solution for the under-damped case is given in (3.60). 
Suppose the initial conditions are u(0) = uo and u’(0) = up. 


a) Show that 
ul — Aug \? 
R = i + — :) . 
bb 


b) How does Figure 3.3 change? 
c) What are R and ¢ if up = 0? 


It is often stated that “the key difference between critical damping and 

overdamping is that critical damping provides the quickest approach 

to zero amplitude.” However, this statement is not true. This problem 
investigates this for the case of when m = 1, k = 4, u(0) = 1, and 

u'(0) = —4. 

a) Find the solution when c = 5, which is the over-damped case, and 
when c = 4, which is the critically damped case. Sketch both 
solutions on the same axes. Explain why the statement is not true. 

b) Solve the two problems in part (a) but use the general initial condi- 
tions u(0) = uo and u’(0) = up. Use this to explain how to modify 
the statement so that it is true. 


It is usually stated that negative damping is unstable. For the mass- 
spring-dashpot system, negative damping means that c is negative. 
From the solution, explain why the system is unstable for any nonzero 
initial conditions. 


Resonance and Forced Motion 


14. 


A block weighing 41b stretches a spring 1.5in. Assume that the block 
is acted on by a periodic forcing as in (3.63), with Fo = 3lb and 
w= 16/sec. At the start, the block is not moving and it is at its rest 
position. Assume that g = 32 ft/s’. 

a) What IVP does u(t) satisfy? 

b) What is the solution of the TVP? 
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c) Sketch the solution for 0 <t < 7. 


15. Suppose that a spring-mass system is at rest but, starting at t = 0, 
the mass is subjected to a force of 5cos 3t N. Assume that the mass is 
2kg, and the spring constant is 18kg/s?. 


a) What IVP does u(t) satisfy? 
b) What is the solution of the IVP? 
c) Sketch the solution for 0 < t < 47. 


16. Suppose the forcing in (3.65) is replaced with Fosinwt. Does this 
change (3.66)? 


17. This exercise considers what happens when the forcing in (3.65) con- 
sists of a combination of driving frequencies. 


a) Suppose the forcing is 
Fo cos wot + Fi, cos wt + Fo cos wat, 


where the F;’s are nonzero, and the w,’s are all different, with wo 
given in (3.49). Does resonance still occur? 

b) Suppose the forcing is Fp coswot cosw it, where Fo is nonzero, w1 # 
wo, and wo given in (3.49). Does resonance still occur? 


3.11 - Euler Equation 


Although second-order equations with constant coefficients are the ones 
that most often arise in applications, there is a notable exception to this 
statement. This is the Euler equation, which is 
2 

pot + bn +cy =0, (3.69) 
where 6 and c are constants. The reason this equation arises as often as 
it does is that it comes from using polar coordinates when solving what 
is known as Laplace’s equation (see Section 7.8.2). 

A complication that arises with (3.69) is that it is not a second-order 
differential equation when x = 0. For this reason, x = 0 is referred to 
as a singular point for the equation. This is an issue as it is often the 
case that the interval used when solving Euler’s equation has the form 
0<a< L. What condition, if any, you can impose at 7 = 0 is a question 
we will consider below. 

In what follows it is assumed that « > 0. Solving (3.69) is rather easy, 
as one just assumes a solution of the form y = x”. Since y! = rx”! and 
y"’ =r(r—1)2"~?, then from (3.69 ) we get that 


r(r—1)+br+c=0, (3.70) 
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The solutions of this quadratic equation are 


r=5(1-b4 (1= 6 = 4c). (3.71) 


Just as in Section 3.3, what happens next depends on the values of r 
obtained from this solution. 


Two Real Roots 


When there are two real-valued roots, say, r; and rg, then the two cor- 
responding solutions of (3.13) are yj = x"! and yg = x”. It is left as an 
exercise to show they are independent. Therefore, the resulting general 
solution of (3.13) is 


y=cir + cea”, (3.72) 


where c; and cg are arbitrary constants. 


One Real Root 


When there is only one root, then you use reduction of order. This means 


that to find a second solution, assume that y = w(x)x". Proceeding as 


in Section 3.3.2, one finds that w = Inz. Therefore, the resulting general 
solution of (3.13) is 


y=cx" +cgln(z)2", 


where c; and cg are arbitrary constants. 


Complex Roots 


In this case, the roots can be written as r = A\ +i, where 


we (l =H (3.73) 


and 
1 
i gv 4e- (1 — b)?. (3.74) 
It is assumed here that 4c > (1 — b)?. Writing the general solution as 


in (3.72), and then separating into real and complex parts using Euler’s 
formula, one finds that the resulting general solution can be written as 


y = dyx* cos(uln x) + dx’ sin(us nz), (3.75) 


where d; and dg are arbitrary constants. 
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3.11.1 » Examples 


Example 1: Find the solution of x?y” + 2ry' — 6y = 0, for 0 < x < 2, 
that is bounded for 0 < x < 2 and satisfies y(2) = 1. 


Answer: Substituting in y = x”, one gets the equation r?+r—6 = 0. 
The solutions of this are r = —3, and r = 2. So, the general solution 
of the differential equation is y = cyz~* + cox”. The requirement 
that y is bounded means that c; = 0. As for y(2) = 1, we need 
c2 = 1/4. Therefore, the solution is 

1 5 


—-,?. O 
y(z) = 7% 
Example 2: Find the general solution of 4x7y"+17y = 0, for 0 < x < oo. 


Answer: Substituting in y = x”, one gets the equation 4r? — 4r + 
17 = 0. The solutions of this are r = $ + 2i. So, from (3.75), the 
general solution is 


y=d,V/zrcos(2Inz)+d2/zrsin(2Inz). 


Exercises 
1. Assuming x > 0, find the general solution of the following Euler equa- 
tions. 
a) x7y" — 3ry' + 4y =0 f) 5a2y"” + 122y' + 2y =0 
b) 27y” — day’ + 10y = 0 g) ry" + ay’ =0 
c) 627y" + Try’ —y =0 h) x?y" — 2ay’ =0 
d) ay" +y=0 i) 2y! ay’ —n(n+2)y = 0, 
e) xy" — 3ay' + 13y =0 where n is a positive integer 


2. Find the solution of the following problems. Before doing these prob- 
lems, you might want to review Exercise 3, on page 65. 
a) x?y" — Qry' + 2y = xe”, where y(1) = 0, and y/(1) =0 
ee 2, "_ Apy! + dy = —227 +1, where y(1) = 0, and y/(1) =0 

— zy’ +y = Ing, where y(1) = 0, and y/(1) = 0 

ie My = x, where y(1) = 1, and y/(1) = —-1 

e) j 1)2y" + (2 — 1)y' — y = 0, where y(2) = 1, and y'(2) =0 


3.12 » Guessing the Title of the Next Chapter 


Since Chapter 2 is about first-order equations, and this chapter is about 
second-order equations, you might expect the next chapter to be about 
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third-order equations. This was often how older textbooks were written, 
where the next chapter would be titled Higher-Order Equations, or some- 
thing similar. Although it is possible to find applications that involve 
higher-order equations, such as viscoelasticity, they are not that com- 
mon. Moreover, the usual method for solving higher-order equations is 
to first rewrite them in system form. This is certainly the approach used 
when solving them numerically. Well, as it turns out, the next chapter is 
about linear systems and the following chapter is on nonlinear systems. 
So, although third-order and higher equations are not considered in this 
text, the methods used to solve them are. 


Chapter 4 


Linear Systems 


This chapter, and the one that follows, consider problems that involve 
two or more first-order ordinary differential equations. Together the equa- 
tions form what is called a first-order system. These are very common. 
To explain why, it is worth considering a couple of examples. 


Example 1: Mechanics 


As stated on several occasions earlier in this text, one of the biggest 
generators of differential equations is Newton’s second law, which states 
that F' = ma. To demonstrate its connection with a system of differential 
equations, let x(t) denote the position of an object. The velocity is then 
v = a’(t), and the acceleration is a = x’(t). So, F = ma can be written 
as mv’ = F. Along with the equation 2’ = v, the resulting system is 


dx 
ee i 
dt i 
dv 1 
dt m 
As an example, for a uniform gravitation field, and including air resis- 
tance, then F' = —mg — cv (see Section 2.3.2). In this case, the system 
becomes 
/ 
L =, 
F c 
v =-g-——v. 
m 


This is a linear first-order system for x and v. It is also inhomogeneous 
since x =O andv=0Oisnotasolution.. MH 


Introduction to Differential Equations, M. H. Holmes, 2023 
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Example 2: Epidemics 


Epidemics, such as the black death, COVID-19, and cholera, have come 
and gone throughout human history. Given the catastrophic nature of 
these events there is a long history of scientific study trying to predict 
how and why they occur. One of particular prominence is the Kermack- 
McKendrick model for epidemics. This assumes the population can be 
separated into three groups. One is the population S(t) of those suscepti- 
ble to the disease, another is the population J(t) that is ill, and the third 
is the population R(t) of individuals that have recovered. A model that 
accounts for the susceptible group getting sick, the subsequent increase in 
the ill population, and the eventual increase in the recovered population 
is the following set of equations [Holmes, 2019] 


dS 

< = -k SI, 

dl 

ak —koI + ky ST, 
dR 

—a=kl. 

ae 4 


Given the three groups, and the letters used to designate them, this is an 
example of what is known as a SIR model in mathematical epidemiology. 
For us, this is an example of a nonlinear first-order system for S$, J, and 
R. The reason it is nonlinear is the SJ term that appears in the first two 
equations. 


As you might expect, solving a nonlinear system can be challenging. 
So, in this chapter, we will concentrate on linear systems. In the next 
chapter, nonlinear problems are considered. 


4.1 » Linear Systems 


To get things started, consider the problem of solving 


x’ =az + by, (4.1) 
y =cx+dy. (4.2) 
This is a first-order, linear, homogeneous system. In these equations, x(t) 


and y(t) are the dependent variables, and a, b, c, and d are constants. 
This can be written in system form as 


()-( aC) 


A simpler way to write this is as 


d 
“es Ax, (4.3) 
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where the vector is 


and the matrix is 


A= (' ; (4.4) 


The equation in (4.3) plays a central role throughout this chapter. Written 
in this way, we could be dealing with 20 equations, or 200 equations, and 
not just the two in (4.1) and (4.2). 

For those a bit rusty on the basic rules for working with matrices and 
vectors, a short summary is provided in Appendix A. 

Before getting into the discussion of how to solve (4.3), it is worth 
considering what we already know about the solution. 


4.1.1 » Example: Transforming to System Form 
In Section 3.5, Example 1, we found that for 
y” +2y' —3y =0 (4.5) 


the roots of the characteristic equation are r; = —3 and rg = 1. The 
resulting independent solutions are y; = e~* and y2 = e’. In this exam- 
ple, the differential equation, along with its solutions, are translated into 
vector form. 


o 
~~” 


Write (4.5) as a linear first-order system as in (4.3). 


The standard way to do this is to let v = y’, so the differential equation 
can be written as v’ + 2v — 3y = 0, or equivalently, v' = 3y — 2v. This, 
along with the equation y/ = v, gives us the system 


on 
yY =v, 


vu’ = By — 2v. 


In other words, we have an equation of the form (4.3), where 


y O41 
> a ; and A= : 
v 3. —2 


Write the two linearly independent solutions in vector form. 


oO 
wa” 


For y; = e*, then v1 = yj, = —3e~*'. Letting x; be the solution vector 
coming from y1, then 


—3t 
Y1 € 1 \ _3¢ rit 
xy = —. = e =aje ) 
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where r; = —3 and 


wee 


Similarly, since v2 = y5 = e’, then letting x2 be the vector version of yo, 


t 
€ 1 
v2 € 1 
1 
a= : 
oN 


Write the general solution in vector form. 


The general solution for the second-order equation is y = cry, + coye. 
From this, we get that v = y’ = ciy, + coys. Therefore, the general 
solution vector is 


ea (eye ciyi + C2y2\ fyi if C2Y2 
v ery}, + cayd cy) coy 


=c,)X, +cox2. HH (4.6) 


A very useful observation to make about the above example is that 
the linearly independent solutions have the form x = ae™, where a is 
a constant vector. In fact, when the time comes to solve (4.3) we will 
simply assume that x = ae”, and then find r and a. Also, note that 
for the single linear equation x’ = az, there is one linearly independent 
solution. As the above example shows, for two linear first-order equations 
there are two linearly independent solutions. Consequently, it should not 
be a surprise to find out that for n linear first-order equations there are 
n linearly independent solutions. 


4.1.2 » General Version 


We are going to consider solving homogeneous linear first-order systems. 
Assuming there are n dependent variables, then the system can be written 
as 


/ 
Ly = Aq X1 + GjQ%Q + +++ AnLn, 


/ 
Lo = A21X1 + a22%2 + +++ AanFn 


! 
Ln = Ani X1 + An2%2 + +++ Ann&n, 
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where the a;;’s are constants. This can be written as 


d 
“ss Ax, (4.7) 


where A is an n X n matrix, and x is an n-vector, given, respectively, as 


x 
ai. 12 ++ Gin 
a21 a2 rates Q2n x2 

A= ; j j and x= 
Anl Gn2 sot ann Ln 


For an initial value problem, an n-vector x9 would be given, and the 
condition to be satisfied would be x(0) = xo. 

Because (4.7) is linear and homogeneous, the principle of superposition 
holds (see page 5). Therefore, if x; and x2 are solutions of (4.7), then 


X = ClX1 + CoX2Q 


is a solution for any values of the constants c; and cg. 
As a final comment, the inhomogeneous equation ax = Ax+f is not 
considered in this chapter, but it is considered in Section 6.8. 


Exercises 


1. Write the following as x’ = Ax, making sure to identify the entries in 
x and A. If initial conditions are given, write them as x(0) = xo. 


a) uw =u-v d) uw =u-v 
vu’ = 2u — 3 vu’ = 2u— 3v 
b) 2u’ = —u u(0) = —1, v(0) =0 
30’ =utv e) a =2r—z 
c) a =x-—yt2z y =xt+ytz 
y =f 32' = 2y + 6z 
2 = —axa + By x(0) = —-1, y(0) = 0, z(0) =3 


2. For the following: i) Write the equation in the form x’ = Ax. ii) Find 
the general solution of the second-order equation and then write it in 
vector form as X = cx, + c2x2, where x; = aye”! and x2 = age”2’. 


Make sure to identify aj, ag, 7; and ro. 


a) y” + 2y’ — 3y =0 c) 4u” + 3u’-u=0 
b) 4y”+y =0 d) u’ + 4u’ =0 
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3. Show that the given vector x is a solution of the differential equation. 
Also, what initial condition does x satisfy? 


1 2 4 
a) = a Sc et 
2 —2 2 
1 
5 1 
c) “= (! )s x= (Je 
fr ube —sint 
2 


4. The vectors x, and xg are solutions of the given differential equation. 
Show that x = c,x) + cpX is a solution no matter what the values of 
cy and Co. 


ls 22 2 1 
— x; = et, xp = ge 
3 41 1 1 
bx = xX, Xp= eb, xXo= er 
2 2 —2 1 


5. This problem considers some of the connections between a second-order 
equation and a first-order system. 


a) Assuming that c 4 0, show that (4.1), (4.2) can be reduced to the 
second-order linear equation 


y” —(a+d)y' + (ad — be)y = 0. 


b) Using the result from part (a), transform y” + 2y’ — 3y = 0 into a 
first-order system where none of the entries in A are zero. 


c) Using part (a), and the example in Section 4.1.1, find the general 
solution of the differential equation in Exercise 3(a). 


4.2 » General Solution of a Homogeneous Equation 


The problem considered here is 


id = Ax, fort>0. (4.8) 
dt 

From (4.6), as well as Exercise 2 in the previous section, we have an idea 
of what the general solution of this equation looks like. Namely, if we are 
able to find n linearly independent solutions x;(t), x(t), ..., Xn(t), then 
the general solution can be written as 


x(t) = c1xi(t) + coxo(t) + --- + cnXn(b), (4.9) 
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where cj, C2, .--, Cn are arbitrary constants. 

The requirement to be linearly independent is a simple generalization 
of the definition given in Section 3.2. Namely, x(t), xo(t), ..., Xn(t) are 
linearly independent if, and only if, the only constants c1, C2, ..., Cn 
that satisfy 


C1X1 + CoXg++-:+enXn =0, Vt>O0, (4.10) 


are cy = 0, co = 0, ..., G = 0. In the above equation, O is the zero 
vector, which means that all of its components are zero. Also, the symbol 
V is a mathematical shorthand for “for all” or “for every.” 

In the last chapter the Wronskian was used to determine indepen- 
dence. It is possible to also use the Wronskian with (4.8), but this is not 
particularly useful for larger n. There is an easier way to show indepen- 
dence, and this will be explained in Section 4.4. 

The general solution of (4.8) is found by assuming that x = ae”, 
where a is a constant vector. Differentiating this expression, x’ = rae”, 
and so (4.8) becomes rae” = A(ae"™). Since e” is never zero we can 
divide by it, which gives us the equation 


Aa=ra. (4.11) 


What we want are nonzero solutions of this equation, and so we require 
that a #0. This problem for r and a is called an eigenvalue problem, 
where r is an eigenvalue, and a is an associated eigenvector. This 
is one of the core topics covered in linear algebra. We do not need to 
know the more theoretical aspects of this problem, but we certainly need 
to know how to solve it. So, for completeness, the more pertinent aspects 
of an eigenvalue problem are reviewed next. 

It is worth pointing out that it is possible to solve (4.8) without using 
eigenvalues and eigenvectors, and how this is done is explained in Section 
6.8. 


4.3 » Review of Eigenvalue Problems 


Given an n xn matrix A, its eigenvalues r and the associated eigenvectors 
a are found by solving 


Aa=ra. (4.12) 


It is required that a is not the zero vector. There are no conditions placed 
on r, and it can be real or complex valued. 

In preparation for solving the above equation, it is first rewritten as 
Aa —ra = 0, or equivalently as 


(A—rI)a=0. (4.13) 
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The n x n matrix I is known as the identity matrix and it is defined as 


1 0 0 
0 1 0 
T= . 
0 0 1 


For example, when n = 2 and n = 8, 


1 
1 O 
r( and [= 
0 1 
0 


In linear algebra it is shown that for the equation (4.13) to have a 
nonzero solution, it is necessary that the matrix A — rI be singular, or 
non-invertible. What this means is that the determinant of this matrix 
is zero. This gives rise to the following method for solving the eigenvalue 


(an) 
oOo - © 
- Oo O 


problem. 


Eigenvalue Algorithm. The procedure used to solve the eigenvalue prob- 
lem consists of two steps: 


1. Find the r’s by solving 
det(A — rI) = 0. (4.14) 


This is known as the characteristic equation, and the left-hand- 
side of this equation is an nth degree polynomial in r. 


2. For each eigenvalue r, find the associated eigenvectors by finding the 


nonzero solutions of 
(A —rI)a=0. (4.15) 


In this textbook we are mostly interested in systems involving two equa- 
tions. For those who might not remember, the determinant of a 2 x 2 
matrix is defined as 


Qi1 G12) 
det = 411422 — Q12Q21. 
a21 422 


In the second step of the algorithm, when solving (4.15), we are inter- 
ested in finding the vectors that can be used to form the general solution 
of this equation. To say this more mathematically, we want to find lin- 
early independent solutions. In n dimensions, it is not possible to have 
more than n linearly independent vectors. Consequently, n is the max- 
imum number of linearly independent eigenvectors you can find for an 
n Xn matrix A. 
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The following examples all involve 2 x 2 matrices. What is illustrated 
are the various situations that can arise with eigenvalue problems. In 
these examples, the eigenvector will be written in component form as 


a= (") : (4.16) 


Example 1: Two Real Eigenvalues 


For 


we get that 


2 1 1 O 2-97 1 
A-rIl= =f = . 
( , ( ; ( 1 se 


Since det(A — rI) = (2—r)? —1 =r? — 4r +3, then the characteristic 
equation (4.14) is r*—4r+3 = 0. Solving this we get that the eigenvalues 
are r) = 3 and rg = 1. For rj, (4.15) takes the form 


-1 1 a\ (0 
1 -1/\b}) \o}° 
In component form, we have that 


—a+b=0, 
a—b=0. 


The solution is b = a, and so the eigenvectors are 


a (") (") aa, (4.17) 
ay = () Hy (4.18) 


For the second eigenvalue rg = 1, one finds that the eigenvectors have the 
form a = aa, where a is an arbitrary nonzero constant and 


where 
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The eigenvectors a; and ag are independent. To show this, note that 


1 1 cy + C2 
cya, + Cgaq = Cy + €Q = . 
1 —l Cy 


So, if cyay + coag = O, then cy + cg = O and cy — co = 0. From the last 
equation, cj = C2, and inserting this into the first equation yields 2cg = 0. 
So, co = 0, and this also means that c; = 0. Therefore, a; and ag are 
independent. MH 


There is an important observation that needs to be made here. In the 
above example it was shown that eigenvectors for different eigenvalues are 
linearly independent. This is always true, and this is important enough 
that it needs to be stated more prominently. 

Different Eigenvalues Test. If a,, a2, ---, a, are eigenvectors corre- 
sponding to different eigenvalues for a matrix A, then these vectors are 
linearly independent. 

The above test applies irrespective of whether the eigenvalues are real or 


complex valued. It also is not limited to a 2 x 2 matrix, and holds in the 
general case of when the matrix is n x n. 


Example 2: One Eigenvalue But Two Independent Eigenvectors 


eet (eed 
0 3 


the characteristic equation is (r — 3)? = 0. So the only eigenvalue is 


r, = 3. In this case, 
0 O 
A-rl= ; (4.19) 
0 O 


This means that all vectors are solutions of (4.15). In other words, the 


solutions are 
a a 4 0 ap 
= = = a 
PNG 0 eae 
1 0 
aj = (") and ag = () 5 (4.20) 


When 


where 
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To check on independence, we are not able to use the Different Eigen- 
values Test given above because a; and ag are eigenvectors for the same 
eigenvalue. To use the definition, note that 


1 0 Cl 
cya, + C2a2 = C1 + C2 = : 
0 1 (63) 


So, if cay + coa2 = O, then we conclude that c; = cg = 0. Therefore, a, 
and aj are independent. = 


Example 3: Complex- Valued Eigenvalues 


a (i ;) 
—4 1)? 


the characteristic equation is r? — 2r + 2 = 0. The resulting eigenvalues 
are r= 1+2and r=1-i. Proceeding as usual, for r1, 


42 £2 
nant ( 1 ). 


This means that (4.15) requires that —ia + 2b = 0, or equivalently, a = 
—2ib. So, the eigenvectors are 


For the matrix 


where 


—2i 
a, = ; 
‘ 1 
Similarly, for rg = 1 — 7, one finds that the eigenvectors are 


a= bay, 


Finally, because a; and ag are eigenvectors for different eigenvalues, they 
are independent. MH 


where 


There is an observation that needs to be made here. In the above 
example, the eigenvalues have the form r; = A+ip and ro = A—ip, where 
» and py are real numbers, with w 4 0. Because of this, the eigenvalues 
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are said to be complex conjugates. When a matrix only contains real 
numbers, and it has complex eigenvalues, the eigenvalues must occur as 
complex conjugates. Moreover, you should notice that the respective 
eigenvectors a; and ag are also complex conjugates (if you change 7 to —7 
in aj, you get ag). This is useful information as it means that once you 
know a,, you immediately know ag. 


Example 4: Only One Independent Eigenvector 


eae inca 
0 3 


has one eigenvalue r = 3 (similar to Example 2). In this case (4.15) 


becomes 
A-rl= a : (4.21) 
0 0 


This means that b = 0. Consequently, the eigenvectors have the form 


The matrix 


where 


In the previous three examples involving 2 x 2 matrices we found two 
linearly independent eigenvectors. This matrix is different as there is only 
one. An n X n matrix that has fewer than n independent eigenvectors is 
said to be defective. So, the matrix of this example is defective, while 
the matrices for the three previous examples are not defective. lf 


Exercises 


1. Determine whether the two vectors are linearly independent. 


on=()a-()  on=(2) =-(7) 
ma=(1)a=(Q)  om=(55)- #=(3) 


2. The following matrices have two real-valued eigenvalues. Find the 
eigenvalues, and two linearly independent eigenvectors. 


4.4. 
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2 1 —2 -7 
»( 4) oF 3) 


3. The following matrices have complex-valued eigenvalues. Find the 
eigenvalues, and two linearly independent eigenvectors. 


2 =A 2 13 
o( 3) »(2 4) 


4. Show that the following matrices are defective. 


570 fy 
°( 5) »(3 3) 


4.4 » Solving a Homogeneous Equation 


As stated earlier, given an n x n matrix A, to find the general solution of 


d 

—x = Ax 4.22 
dt p) ( ) 
you start by assuming that x = ae”, where a is a constant vector. Sub- 
stituting this into the differential equation, and simplifying, leads to the 


eigenvalue problem 
Aa=ra. (4.23) 


If A is not defective, then there are n linearly independent eigenvectors 
a1, a2,..., An. Letting r1, r2, ..., Tn be their respective eigenvalues, then 
the general solution of (4.22) can be written as 


x = cyaye™ + cgage™ +--+ + crane’, (4.24) 


where the c;’s are arbitrary constants. 

The vectors x; = aje"i’ used in the above formula for the general 
solution are linearly independent. The reason is that the test for inde- 
pendence in (4.10) must hold at t = 0. Since the a;’s are independent, it 
follows that the c;’s are all zero. Consequently, the vectors x; are linearly 
independent. 

With the formula for the general solution in (4.24), all that is left to 
do is consider how to rewrite it when the eigenvalues are complex and to 
also determine what to do when the matrix is defective. A summary of 
what follows in given in Section 4.5. 


4.4.1 » Complex-Valued Eigenvalues 


As usual, when the roots are complex-valued there are options as to how 
the general solution can be written. It is certainly possible to just use the 
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expression in (4.24). However, it is often easier to rewrite the solution so 
as to avoid the use of complex variables. It is easiest to explain how this 
is done using an example. 


Example 


The matrix in the differential equation, 


; 1 2 
x= 1 Xx, 
-5 1 


is the one considered in Example 3 of the previous section. The eigenval- 
ues are r= 1+2and r=1-i. Using the eigenvectors found earlier, the 
general solution can be written as 


x=C] ke eIt)t 4 Ep ()) elit 


Because complex numbers are used for the r’s, both c; and cg must be 
allowed to be complex-valued. 

Given that x is real-valued, the coefficients cy and cg must be complex 
conjugates. In other words, if c. = a+i@, where a and @ are real-valued, 
then it must be that co = a—if. We are going to separate the solution 
into real and imaginary parts, which for the eigenvectors means that 


CG) GQ) 


It makes things a bit easier to write these as 


where 
0 q —2 
— ni => fe 
p 1}? a q 0 
Now, using Euler’s formula (3.13), we have that 
x = (a+ iB)(p + iq)e' (cost + isint) + (a — i8)(p — iq)e' (cost — isin t) 
= d;(pcost — qsint)e! + do(psint + qcost)e! 
=n (: sin ‘ Says . ‘ et, 
cost sint 


where d; = 2a and dz = —2@ are arbitrary real-valued constants. 
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General Formula 


To summarize what was done in the above example, suppose that A is a 
2x 2 matrix with complex-valued eigenvalues ry = A+ip and rg = A—ip, 
where \ and p are real-valued with wp 4 0. Also, suppose that ay = p+iq, 
where p and q are vectors containing only real numbers, is an eigenvector 
for r;. In this case, ag = p—7q is an eigenvector for r2. Moreover, instead 
of writing the general solution as 


t 


mt + coage’™, 


xX = Cjaje 
it can be written as 
x(t) = db ,e™* + dgb:e™, 


where 
bi = pcos(yt) — qsin(pt), 
by = psin(yit) + qcos(p2), 


and d; and dg are arbitrary real-valued constants. 


4.4.2 » Defective Matrix 


The other case to consider is what to do when there are not enough 
linearly independent eigenvectors, which means that A is defective. So, 
suppose that A is a 2 x 2 matrix that has one eigenvalue r, and a is its 
associated eigenvector. Based on the way we fixed the single root solution 
in Chapter 3, you might expect for the vector version you should assume 
a solution of the form x = bte’™. However, this does not work, and to 
find a second independent solution, the assumption is that 


x = ate™ + be™. 


To find b, the above expression is substituted into the differential equation 
to obtain 


Ab=rb+a, 


or equivalently 
(A —rI)b=a. (4.25) 


It is useful to know that we don’t need all solutions of this equation. 
Rather, all we need is just one of them. Once this is determined, the 
general solution is 


x = cjae”™ + co(ta+ bye”. 
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4.5 » Summary for Solving a Homogeneous Equation 


Assuming that A is 2 x 2, then the general solution of x’ = Ax is as given 
below. 


I) When A is not defective. 


e If A has real eigenvalues rj and rg, with respective eigenvectors 
a, and ag, then 
x = cyaye™ + cgage”™". (4.26) 
This expression can be used when r; = rp (in this case, just make 
sure a; and ag are independent). 


e If A has complex eigenvalues r = A+ i (with w 4 0), with 
respective eigenvectors p + iq, then 


x(t) = dib,e™* + dgabze™, (4.27) 
where 


bi = pcos(ut) — qsin(ut), 
be = psin(ut) + qcos(pt). 


II) When A is defective, with eigenvalue r and eigenvector a, then 
x = cyae™ + co(ta+b)e™, (4.28) 
where b is any solution of 


(A—rI)b=a. (4.29) 


Example 1 (real eigenvalues): Find the general solution of 


Step 1: Find the eigenvalues and eigenvectors. Using the eigenvalue 
algorithm, from (4.14), 


—T 1 
dett(A-—rI)=0 => ss ( )=0 
ir 


=> por 2=0 
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For r = —1, then from (4.15), 


1 


1 
(A-rI)ja=0 = ( 
2) 32 


Jano => at+b=0. 


So, b = —a, and this means that 


where 


In a similar manner, one finds that for r = 2, an eigenvector is 


Step 2: Since this is a non-defective matrix with real eigenvalues, 
the general solution is 


Example 2 (complex eigenvalues): Find the solution of the IVP: 


a oe _(0 
“-(% i) where «0 =(}). 


Step 1: Find the eigenvalues and eigenvectors. Using the eigenvalue 
algorithm, from (4.14), you find that the eigenvalues are r; = 1+7% 
and rg = 1 — 7. To determine the eigenvector for r;, we have that 


_ (2-1 +9) 1 _ fi-i 1 
aant=( 2 sain) 7 C5 aa) 


So, writing a as in (4.16), then (A — r;I)a = 0 can be written in 
component form as 
(1-i)ja+b=0 
—2a —(1+1%)b =0. 


Both equations lead to the conclusion that b = —(1—i)a. So, the 
eigenvectors are 
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As explained earlier, it makes things easier to write aj = p+ iq, 


which means that 
1 
=p+igq, 
es ai 


Moreover, because the eigenvector for ro = 1 —i is the complex 
conjugate of a;, then ag = p — iq. 


where 


Step 2: Find the general solution. Since there are complex eigen- 
values, from (4.27), the general solution is 


x= db, e° + dabye", 


where 


and 


bg = : int . t 
2= = sint + cp 


Step 3: Satisfy the initial condition. Setting t = 0 in the general 
solution, we get that 


“()+4()=(): 


This can be written in component form as 


d, =0 
—di +dyg=1. 


So, dj = 0 and dz = 1. 
Step 4: The resulting solution is 


x0) | (1) sint + (") cos t 


Example 3 (defective matrix): Find the solution of the IVP: 


ee a i 
aa Ge i) where «=(3). 


ce’. 
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Step 1: Find the eigenvalues and eigenvectors. Using the eigenvalue 
algorithm, from (4.14), you find the single eigenvalue r = 2, with 


eigenvector 
1 
a= : 
1 


To find a second independent solution, from (4.29) we must solve 


A solution of this is 


v=(). 


Step 2: Find the general solution. Using (4.28), the general solu- 


tion is 
1 1 0 
X=C] () a +co|t () + (") |e 


Step 3: Satisfy the initial condition. Setting t = 0 in the general 
solution, we get that 


“)roG)-() 


This gives us cy = —1 and cy + co = 2. So, cg = 3. 


Step 4: The resulting solution is 


b)-() 


Exercises 


1. Find a general solution of the following differential equations. 
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(4-28 Pare an 
ox=(; “is ) “= (; )s 


2. Find the solution of the initial value problem x’ = Ax, where the 
differential equation is given in the previous problem, and the initial 


condition is x(0) = (=) 


3. A solution of x’ = Ax is given below. What are the eigenvalues of A, 
and what are corresponding eigenvectors? 


e-8t _ ent 
b) xt = (Jems (3) a) xi =( aa 


4. The general solution (4.24), and the eigenvalue algorithm given in Sec- 
tion 4.3, can be used for any dimension n. In this exercise you are to 
find the general solution for the case of when n = 3. 


0 1 1 —2 2 O 
ays St Os cx =) O10 x 
1 0 4 2 -1 
1 12 -1 0 O 
b) x= |O. 2 Ox dj) x=] 0 Dx Ex 
0 1 1 2 -1 


5. Two tanks containing salt water are connected as shown in Figure 4.1. 
In the lower connecting pipe, water is pumped from tank 1 into tank 
2 at a rate of N liters/min, and in the upper pipe water in pumped 
from tank 2 into tank 1 at the same rate. Assume that y;(t) and yo(t) 
are the amounts of salt in the respective tank at time t, and the total 
volume of water in each tank is V liters. You should assume that the 
pipes are so short that whatever water, or salt, in them can be ignored. 
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Figure 4.1. Two tanks containing salt water as described in Exercise 5. The 
pipes connecting the tanks are used to pump salt water between the tanks. 


a) Show that the resulting differential equations are 


b) Assume that N = 2liters/min, V = 100 liters, and the initial con- 
ditions are: yi(0) = 10gm and y2(0) = 0. Find yi(t) and yo(t). 

c) What are the limiting values of y; and y2 as t > co? Explain why 
this answer is obvious given how the tanks are configured. 


4.6 » Phase Plane 


For differential equations involving 2 x 2 matrices, there are different ways 
the solution can be portrayed. As an example, the general solution of the 
differential equation 


is 


x(t) =e () e* + eg (*) é (4.30) 


or, in component form, 


a(t) = cye** + coe’, 
y(t) = cye** — cpe’. 

Given values for c, and c2, using the component form, graphing the solu- 
tion simply involves plotting x and y as functions of t. In contrast, with 
the vector version (4.30), the solution traces out a curve in the z,y-plane, 
with t being the parameter that generates the curve. The x,y-plane is 
referred to as the phase plane, and the curves that can be generated 
using (4.30) are known as integral curves. 
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4.6.1 » Examples 


Two Positive Eigenvalues. 


The solution (4.30) involves two positive eigenvalues, r; = 3 and rg = 
1. The resulting integral curves generated by (4.30) are shown in Table 
4.1(a). Each curve corresponds to a specific choice for c; and cz, and the 
arrows indicate the direction for increasing t. Together, the integral curves 
provide what is called a phase portrait for the equation. Any equation 
with two positive eigenvalues will produce a phase portrait that is roughly 
similar to the one for this example. A non-defective matrix with only one 
eigenvalue, which is positive, will also have a roughly similar phase plane, 
except the blue curves will be straight lines. 

To explain how the phase portrait is constructed, you start by consid- 
ering what happens when cz = 0, and then when c; = 0. 


cg =0: Since x = c] G)e*, then x = cje** and y= cje*. In other 


words, y = x. This is the red line in Table 4.1(a) with positive 
slope. Because e* increases with t, the solution moves outward, 
away from the origin. So, the arrows on the line point outward. The 
key observation here is that the line is determined by the eigenvector 


a, = (7) , and the direction on the line is determined by the positivity 
of the corresponding eigenvalue r; = 3. 


cy =0: Since x = a(t je then x = ce’ and y = —cge’. In other 


words, y = —2z. This is the red line in Table 4.1(a) with negative 
slope. Because e® increases with t, the solution moves outward, away 
from the origin. So, the arrows on the line point outward. The key 
observation here is that the line is determined by the eigenvector ag = 


(2h) and the direction on the line is determined by the positivity 


of the corresponding eigenvalue rp = 1. 


cy #0 and co #0: The general solution (4.30) consists of the addition of 
the two components we just considered, and some of the resulting 
integral curves are shown with the blue curves in Table 4.1(a). The 
arrows on the curves point outward, away from the origin, because 
both eigenvalues are positive. Also, since r; > r2, each solution curve 
increases faster in the direction determined by aj, and this is the 
reason that the blue curves bend the way they do. Finally, note that 
if you run time backwards, so t +> —oo, then, from (4.30), x > 0. 
That is why all of the blue curves look like they are emanating from 
the origin. 
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a) 1 >0,r2>0 
source 


y-axis 


x-axis 


c) TY <0, r2 <0 
sink 


y-axis 


x-axis 


e) r=A+ip with A\>0 
spiral source 


y-axis 


-1 0 1 
x-axis 


y-axis 


y-axis 


y-axis 
o 


b) 1 >0,7r2 <0 
saddle 


x-axis 


d) r=+tip 
center 


10 


f) r=A+ip with \ <0 
spiral sink 


4 


-1 0 
x-axis 


Table 4.1. Examples of integral curves and how they depend on the eigenval- 
ues of A. Each curve corresponds to a specific choice for the constants appearing in 
the general solution. The arrows indicate the direction for increasing t. It is assumed 


here that u #0. 
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One Positive and One Negative Eigenvalue. 


An example of this arises with the differential equation 


; -1 3 
x= x, 
2 O 


which has eigenvalues r; = 2 and rg = —3. The general solution is found 


to be 
T\ ot 3) 3 
x(t) = cy ihe +c peor (4.31) 


The resulting integral curves are shown in Table 4.1(b). Any equation 
with one positive, and one negative, eigenvalue will produce a phase por- 
trait that is roughly similar to the one for this example. 

As with the previous example, the phase portrait is constructed by 
considering what happens when cp = 0, and then when c; = 0. 


c2 =0: Since x = cj} (ea, then x = cye*’ and y = cye*’. In other 


words, y = x. This is the red line in Table 4.1(b) with positive 
slope. Because e”’ increases with t, the solution moves outward, 
away from the origin. So, the arrows on the line point outward. The 
key observation here is that the line is determined by the eigenvector 


aj = Ga and the outward direction on the line is determined by the 


positivity of the corresponding eigenvalue r; = 2. 


*) e~*, then x = 3cge’ and y = —2cge!. In other 


words, y = —22/3. This is the red line in Table 4.1(b) with negative 
slope. Because e~** decreases with ¢t, the solution moves inward, 
toward from the origin. So, the arrows on the line point inward. The 
key observation here is that the line is determined by the eigenvector 


cy = 0: Since x = c2( 


a2 = en and the inward direction on the line is determined by 


the negativity of the corresponding eigenvalue rg = —3. 

cy #0 and cp #0: The general solution (4.30) consists of the addition of 
the two components we just considered, and some of the resulting 
integral curves are shown with the blue curves in Table 4.1(b). To 
explain the arrows, the contribution of cga,e~** goes to zero as t 
increases, but cja,e*" becomes unbounded. A consequence is that a 
solution curve will asymptotically approach the red liney=z. MH 


Two Negative Eigenvalues. 


An example of this arises with the differential equation 
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which has eigenvalues rj; = —1 and rg = —3. The general solution is 


found to be 
2 —2 
x(t) = cy () e ' +e, ( , go (4.32) 


The resulting phase portrait is shown in Table 4.1(c). Any equation with 
two negative eigenvalues will produce a phase portrait that is roughly 
similar to the one for this example. A non-defective matrix with one 
eigenvalue, which is negative, will also have a roughly similar phase plane, 
except the blue curves will be straight lines. 

The construction of the phase portrait is very similar to what was done 
for the two positive eigenvalues case. The principal difference is that the 
eigenvalues are now negative, so the movement along the integral curves 
is towards the origin. 


Imaginary Eigenvalues. 


When the eigenvalues are imaginary, the integral curves are concentric 
ellipses centered at the origin (see Exercise 7). To demonstrate this, 
consider the differential equation 


The eigenvalues are r, = 27 and rg = —2i, and the general solution, from 


(4.27), is 
2 0\. 2\., 0 
<() ay | () cos 2t— (") sin 2t () sin 2t+ (‘) cos | . (4.33) 


Some of the ellipses generated by this solution are shown in Table 4.1(d). 

The question is, is the movement around each ellipse clockwise, or 
counter-clockwise? This can be determined from the differential equation. 
For this example, x’ = —22+4y, which means that when an ellipse crosses 
the x-axis (so y = 0), 2’ = —2zx. Consequently, along the positive z-axis, 
x’ <0. The direction of the arrows must be consistent with this, and so 
the rotation is clockwise. More about the direction of rotation, as well as 
the tilt of the ellipse, is discussed in Exercise 5. ll 


+d 


Complex Eigenvalues. 


When the eigenvalues have nonzero real and imaginary parts the integral 
curves are spirals centered at the origin (see Exercise 7). As an example, 
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has eigenvalues r; = 1+ 32 and rg = 1 — 3%. The general solution, from 


(4.27), is 
x(t) = dy (.!) cos 3t — () sin | ef 
() sin 3t + () cos | ef. (4.34) 


Similarly, for the differential equation 


a oe es 
x= X, 
—10 0 


the eigenvalues are ry = —1 + 32 and rg = —1 — 3i. The general solution 


x(t) = dy (;) cos 3t — () sin | et 
() sin 3t + () cos | et. (4.35) 


The resulting integral curves for these two examples are shown in Table 
4.1 (lower row). The one on the left comes from (4.34). The outward 
motion in this case is because the real part of the eigenvalue is positive. 
The one of the right comes from (4.35), and the inward motion is because 
the real part of the eigenvalue is negative. 

The spiral curves seen in these two graphs are explainable from the 
formula for the solution. The solution contains cos ut and sin pt terms, 
and these are responsible for the motion around the origin. This is similar 
to what happens when r = +i. However, these terms are multiplied by 
e* and this causes the radial distance from the origin to either increase, 
when A > 0, or decrease, when A <0. 


+ do 


+ do 


4.6.2 » Connection with an IVP 


To illustrate the role the phase plane can play when solving an initial 
value problem, suppose the problem to solve is 


et ee 
“(5 i) (4.36) 


x(0) = e (4.37) 


where 
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y-axis 


Figure 4.2. The solid blue curve is the solution (4.88), and the solid blue dot 
is the location of the initial condition (4.87). The dashed blue curves, and the red lines, 
are integral curves for (4.36). 


This is the same differential equation used for the phase plane example in 
Table 4.1(b), and the general solution is given in (4.31). From the initial 
condition, the solution is found to be 


x(t) = ; () et 4 : (3) er (4.38) 


The plot of this curve in the phase plane is shown in Figure 4.2. The 
integral curves for the differential equation, which appear in Table 4.1, are 
also included in the figure. As this shows, the solution of the initial value 
problem is simply a portion of one of its integral curves. The starting 
point is determined by the initial condition, and the resulting solution 
follows the respective integral curve for increasing t. 

The above observation is true in general. Namely, the integral curves 
in Table 4.1 are illustrations of the various solutions you can get with the 
respective differential equation. Which curve, or how much of the curve, 
you get depends on the location of the initial condition. 


Exercises 


1. Phase portraits are shown in Figure 4.3, with arrows on some of the 
curves. Do, or answer, the following: (i) Draw arrows on the other 
curves. (ii) What properties of the eigenvalues result in the integral 
curves shown in the phase portrait? (iii) Three different initial condi- 
tions are shown by the black dots. For each one, sketch the solution 
for the resulting IVP. 
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10 
x-axis x-axis 
5 
0 he 
-10 5 10 
x-axis x-axis 
5 


L 1 1 5 i L 
5 0 5 10 -10 5 0 5 10 
x-axis x-axis 


Figure 4.3. Integral curves, and location of three initial conditions, for Exercise 1. 


2. The eigenvalues for the following equations are real-valued. You are 


to sketch the phase portrait as follows: (i) Draw the (red) lines that 
are determined from the eigenvectors, and include the four arrows. (ii) 
In each of the four quadrants determined by the red lines, include two 
integral curves, with arrows. 


fe = fs 2 
ox= (8 a aa (?, *)s 
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3. The eigenvalues for the following equations are imaginary. You are to 


sketch the phase portrait as follows: draw three concentric ellipses cen- 
tered at the origin with arrows indicating the direction of motion. You 
should use the information in Figure 4.4 when sketching the ellipses. 


. The eigenvalues for the following equations are complex-valued. You 


are to sketch the phase portrait as follows: draw three spiral curves, 
with arrows indicating the direction of motion. You should use the 
information in Figure 4.5 when sketching the spirals. 


. For the matrix A in (4.4), if the eigenvalues are imaginary, and a # 0, 


then the elliptical integral curves are either tilted left, or tilted right, 

as illustrated in Figure 4.4. This exercise determines which one you 

get. This is done using the point where the ellipse crosses the positive 
x-axis (shown by a red dot in each figure). From (4.1), at the red dot 

(so y = 0), 2’ = ax and y/ =cz. 

a) If a > 0, then at the red dot, x’ > 0. Use this to explain why the 
solution moves clockwise when the ellipse is left-tilted and counter- 
clockwise when right-tilted. 

b) How does the answer in part (a) change when a < 0? 


ac<0 ac>0O 
a a 
50 50 
> > 
0 0 
x-axis x-axis 


Figure 4.4. Left-tiled (on the left) and right-tilted (on the right) ellipses when 


there are imaginary eigenvalue (see Exercise 5). 


112 


Chapter 4. Linear Systems 


c) For the left-tilted ellipse, if a > 0 explain why it must be that c < 0, 
while if a < 0 then it must be that c > 0. Show that the opposite 
happens for the right-titled ellipse. This explains the labeling ac < 0 
and ac > 0 in Figure 4.4. 

d) Determine if a and c for Figure 4.3(e) are positive or negative. 


. Spirals are either left (sinistral) or right (dextral) handed as shown in 


Figure 4.5. This exercise determines which one you get. This is done 
using the point where the spiral crosses the positive x-axis (shown by 
a red dot in each figure). From (4.1), at the red dot (so y = 0), 2’ = az 
and y’ = cx. For the matrix A given in (4.4), assume the eigenvalues 
are A+ ip. It is possible to show that « 4 0 requires that c 4 0 (you 
do not need to prove this). 
a) If c > 0, then at the red dot, y/ > 0, and if c < 0, then at the red 
dot, y’ < 0. Use this to show that you get a left-handed spiral if 
Ac > 0 and a right-handed spiral if Ac < 0. 


b) Determine if c for Figure 4.3(c) is positive or negative. What about 
for Figure 4.3(d)? 


. This exercise involves the proof of some of the statements made about 


the integral curves when the eigenvalues are complex-valued. The ma- 
trix A is given in (4.4), and it is assumed that ps 4 0. 


a) Assuming that d; and dz are not both zero, from (4.27) and the 
identity cos?(yt) + sin?(ut) = 1, show that 


(p5 + q3)a* — 2pipoxy + pry? = ke, 


where p; = 0, pp = A\—a, gg = yp, and k is a positive constant. 

b) In part (a), what equation is obtained when there are imaginary 
eigenvalues? Explain why this verifies the statement that when 
there are imaginary eigenvalues the solution curve is an ellipse cen- 
tered at the origin. 


Ac>0 Ac<0 
2 20 
x x 
° : 
>0 > 
0 0 
x-axis x-axis 


Figure 4.5. Left-handed (on the left) and right-handed (on the right) spirals 


(see Exercise 6). 
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c) Show that to have a circular curve requires b 4 0 and c= —b. 
d) Explain why you get a spiral in the case of when A # 0. 


4.7 » Stability 


The phase plane can be useful for visualizing stability or instability of 
a steady state solution. To explain how, recall from Section 2.4 that a 
steady state is a constant that satisfies the differential equation. So, for 
the equation x’ = Ax, a steady state is a constant vector x, that satisfies 
Ax, = 0. To avoid complications, it will be assumed that A is invertible, 
which means that the only steady state solution is x, = 0. It is useful to 
know that A is invertible if, and only if, r = 0 is not an eigenvalue for A. 

The definitions of unstable and asymptotically stable are effectively 
the same as in Section 2.4. Namely, a steady state x, is asymptotically 
stable if any initial value x(0) chosen near x, results in 


Jim x(t) = xs. (4.39) 
The steady state is unstable if, no matter how close to x, you restrict 
the choice for x(0), it is always possible to find an initial value x(0) that 
results in the solution x(t) becoming unbounded as ¢ increases. 

It is easy to determine stability using the phase plane. For example, 
in Table 4.1(a), when r; > 0 and rg > 0, the arrows on the integral 
curves indicate movement out away from the origin. Consequently, this 
is an example of when x, = 0 is unstable. Conversely, when r; < 0 and 
rg <0, the flow in towards the origin, and this means x, = O is asymp- 
totically stable. In fact, looking at the various possibilities in Table 4.1, 
you conclude that if A has an eigenvalue with Re(r) > 0, then the steady 
state in unstable. Similarly, if the eigenvalues of A are both negative, or 
if Re(r) < 0, then the steady state is asymptotically stable. 

The conclusions in the previous paragraph were made using the phase 
portraits in Table 4.1. For those that prefer more rigorous derivations, 
then the formulas for the general solutions given in Section 4.5 can be 
used. 

Our classification of a steady state being unstable or asymptotically 
stable does not include what happens when the eigenvalues are imaginary. 
As shown in Table 4.2(d), the solution does not decay to zero, or blowup, 
but simply encircles the origin. So, the steady state is stable but it is not 
asymptotically stable. In this case, x, is said to be neutrally stable. 

The other case we are missing here is what happens when the matrix is 
defective. From (4.28), the conclusion we had earlier still holds. Namely, 
if r < 0, then we have asymptotically stability, and if r > 0, then we have 
instability. 
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The above discussion is summarized in the following theorem. 


Stability Theorem for a Linear System. For x’ = Ax, if r = 0 is 
not an eigenvalue for the 2 x 2 matrix A, then the following hold: 


1. If all of the eigenvalues of A satisfy Re(r) < 0, then x, = 0 is an 
asymptotically stable steady state. 


2. If A has one or more eigenvalues with Re(r) > 0, then xs = 0 is 
an unstable steady state. 


3. If the eigenvalues of A are imaginary, then x, = O is a neutrally 
stable steady state. 


The first two conclusions in the above theorem hold when A is n x n. 
The third one, however, needs to restated as follows: if A has imagi- 
nary eigenvalues, all of which are non-defective, and all eigenvalues satisfy 
Re(r) < 0, then x, = 0 is a neutrally stable steady state. 

For those who might be wondering what happens when r = 0 is an 
eigenvalue, the solution of Ax = 0 is no longer just x, = O. In fact, any 
and all eigenvectors for r = 0 are steady state solutions. It is possible to 
examine the various cases that arise in this situation related to stability, 
but this will not be considered in this text. 

In addition to their stability, steady states are often identified by the 
geometric properties of the solution near the steady state. So, for example, 
because of the outward direction of the flow in Figure 4.1(a), the steady 
state is called a source. In contrast, because of the inward flow in Figure 
4.1(c), the steady state is called a sink. For similar reasons, the flow in 
Figure 4.1(e) is a spiral source, and the one in Figure 4.1(f) is a spiral 
sink. Finally, the steady state in Figure 4.1(b) is a saddle, and the one 
in Figure 4.1(d) is a center. 


Example 1: Determine the stability of the steady state x, = O for 


5 ahd) 28 
x = xX. 
2 24 


Answer: The characteristic equation for the matrix is r?+3r—10 = 
0, and from this it follows that the eigenvalues are r = —5 and r = 2. 
Given that there is at least one eigenvalue that is positive, x, = O 
is unstable. Moreover, since it has one positive, and one negative, 
eigenvalue, the steady state is a saddle point. 


Example 2: Determine the stability of the steady state x, = O for 


a ee 
x = x 
2 0 
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Answer: The characteristic equation for the matrix is r?+r+4 = 0, 
and from this it follows that the eigenvalues are r = 5(—14iV15). 
Given that both have negative real part, then x, = O is asymp- 
totically stable. Moreover, since the eigenvalues are complex with 
negative real part, the steady state is a spiral sink. MH 


Example 3: Find the steady state, and determine its stability for 


Rae S + : (4.40) 
u = u : 
1 -l 4 
Steady State: Since a steady state is a constant vector that satisfies 
the differential equation, then we require that 


( )e-() 


Solving this for u, one finds the steady state 


Stability: Letting u = u, + x, and substituting this into the differ- 
ential equation, one finds that x’ = Ax, where A is the matrix in 
(4.40). If x, = 0 is unstable, then so is us. Similarly, if x, = 0 
is asymptotically stable, then u, asymptotically stable. Now, the 
characteristic equation for A is r? — 2 = 0. From this, the eigen- 
values are found to be r = +V2. Given that one is positive, x, is 
unstable, and therefore u, is unstable. Moreover, since it has one 


positive, and one negative, eigenvalue, us is a saddle point. MH 


Exercises 


1. Determine whether x, = O is an asymptotically stable, unstable, or 
neutrally stable steady state for the following differential equations. 


Also, state whether the steady s 
source, saddle, or center. 


oe’ pe 
n= (7 E ey x= 


b) x= @ “x d) x/ = 


tate is a sink, source, spiral sink, spiral 
3 1 —-1 -l 
x e) xX = x 
1 3 6 —-6 
2 1 
x 
3 4 
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re eee oe ne Pe ome 
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. Write the following as x’ = Ax, and then determine whether x, = 0 


is an asymptotically stable, unstable, or neutrally stable steady state. 


a) The simple harmonic oscillator given in (3.48). 

b) The damped oscillator given in (3.55), with c > 0. 

c) It is usually stated that negative damping is unstable. For the mass- 
spring-dashpot system, negative damping means that c is negative. 
Is the system unstable in this case? 


. Find the steady state u,, and determine its stability, for the following 


differential equations. Also, state whether the steady state is a sink, 
source, spiral sink, spiral source, saddle, or center. 


vw=(i2)e() 9G Be () 
mae? Ljer(e) oe (t a)(4) 


. This exercise contains useful information to determine the stability of 


x, = 0 without having to calculate eigenvalues. Assume that A is 

given in (4.4) and that det(A) 4 0. Also, the trace of a matrix is the 

sum of the numbers on the diagonal. The formula is tr(A) = a+ d. 

a) Show that the eigenvalues of A are 5[tr(A)+\/[tr(A)]? — 4det(A)]. 

b) Explain why r = 0 is not an eigenvalue for A. 

c) Show that if tr(A) > 0, then x, is unstable. 

d) Show that if det(A) < 0, then x, is unstable. 

e) Show that if tr(A) = 0, and det(A) > 0, then x, is neutrally stable. 

f) Show that if tr(A) < 0 and det(A) > 0, then x, is asymptotically 
stable. 


. Determine whether x, = O is an asymptotically stable, unstable, or 


neutrally stable steady state for the following differential equations. 


-l1 1 2 —3 0 
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—2 0 0 =2. 0 

c)x’=] 0 1 -4]x e) xX =] 0 2. 3e 
0 1 1 0 -5 -1 
1 0 4 —5 O 2 

d)x’=] 0 -1 O]x f)x’=| 0 -2 O|x 
—-4 0 1 —-5 0 1 


4.8 » Modeling 


Many of the modeling problems we have considered in the earlier chap- 
ters can be extended so they result in a system of differential equations. 
For example, this happens for the mixing problem associated with the 
connected tanks shown in Figure 4.1, and this is explored in Exercise 5 
on page 102. Below are exercises that investigate extensions arising with 
the oscillator material from Section 3.10. 


Exercises 


1. For the mass-spring dashpot system shown in Figure 4.6, let u(t) be 
the vertical displacement of the mass. Using F’ = ma one finds that 
the differential equations to solve are (Holmes [2019]) 


=e 
waait cf 


The task is to find the displacement u(t) and the force f(t). Assume 
that the initial conditions are u(0) = uo, u’(0) = 0, and f(0) = kuo. 
The configuration in Figure 4.6 is associated with a Maxwell material 
in viscoelasticity, while Figure 3.1 is for a Kelvin-Voigt material. 


a) Setting v = wu’, write the above two differential equations as a first- 
order system for v and f. What are the initial conditions? 

b) Taking k = 1, c=1, m=1, and up = 1, find v(t) and f(t). 

c) Determine u(t). 


Figure 4.6. Coupled mass-spring-dashpot system considered in Exercise 1. 


118 Chapter 4. Linear Systems 


2. Two masses m, and mg are connected by springs as shown in Figure 
6.6. Let ui(t) and ug(t) be the vertical displacements of the upper and 
lower mass, respectively. Using Hooke’s law, the spring forces on mj, 
are —kyu, and k2(ug—w1), while the spring force on mg is —k2(u2—u1). 
The resulting differential equations are 


" 
Miu, = —kyu, + ko(ue = U1), 


muy = —k(ug = U1). 


a) Show that the differential equations can be written in system form 
as u’ = —Ku, where the displacement vector u(t) has components 
ui(t) and ug(t). This is a second-order linear system for u(t). For 
the record, K is called the stiffness matrix (per unit mass). 

b) Assuming u = ae”, show that the differential equation in part (a) 
reduces to Ka = —r?a. This shows that —r? is an eigenvalue for 
K, with corresponding eigenvector a. 


c) Taking m, = 2, m2 = 1, k; = 4, and kg = 2, find the two eigenvalues 
for K, and their associated eigenvectors. 

d) If \ is an eigenvalue you found in part (c), then from part (b), 
r =+V/-—X. This results in the two solutions u = aeV *t and u= 
ae VE, These, along with the two solutions for the other eigen- 
value, gives the general solution u = cyayev >t + coaje Vt + 
cgage¥ rt + cyage V—2¢. What does this reduce to using the val- 
ues from part (c)? 


e) Using your answer in part (d), determine the solution u when 
ui1(0) = 0, ui (0) = 1, ue(0) = 0, and u4(0) = 0. 


Figure 4.7. Coupled mass-spring system considered in Exercise 2. 


Chapter 5 


Nonlinear Systems 


This chapter considers problems that involve two first-order ordinary 
differential equations, at least one of which is nonlinear. These problems 
are usually difficult enough that finding a formula for the solution is not 
possible. Consequently, most of the chapter does not concern solving 
these problems, but instead concentrates on developing ways to determine 
the properties of the solution. What this means will be explained as the 
methods are derived. We begin with examples that illustrate the problems 
we will be considering. 


Example 1: Pendulum 


The equation for the angular deflection of a pendulum is (see Figure 5.1) 


a0 
Ca =-—gsin6, (5.1) 
where the initial angle 6(0) and the initial angular velocity 6’(0) are as- 
sumed to be given. Also, @ is the length of the pendulum and g is the grav- 
itational acceleration constant. Introducing the angular velocity v = 6’ 
then the equation can be written as the first-order system 


Go; (2) 


v' = —asin 0, 5.3 


where a = g/. Although (5.2) is linear, (5.3) is nonlinear because of the 
term sin @. Consequently, together (5.2), (5.3) form a nonlinear first-order 
system for @ andv. MH 
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Figure 5.1. Angular deflection of a pendulum. 


Example 2: Measles 


A model for the spread of a disease, like measles, is 


dS 
yore = (BI + a)S, 
dl 
ht = BIS —(a+y)l. 


In these equations, S(t) is the number of people susceptible to the disease, 
and I(t) is number that are ill. The nonlinearity, which is due to the term 
IS, appears in both equations. MH 


Nonlinear systems are usually not solvable using elementary functions. 
What is possible it to ask questions about the solution that are signifi- 
cant and answerable. As an example, with measles, a reasonable question 
would be: what would it take to eliminate the disease from the popula- 
tion? This requires that J > 0 as t > oo (and the faster this happens 
the better). In more mathematical terms, we want J = 0 to be an asymp- 
totically stable steady state. How to modify the stability of J = 0, with 
the goal of quickly eliminating the disease, will be considered in Section 
5.2.2. 

A question arising with the pendulum is, does it ever stop moving? 
Given the physical assumptions used in the derivation of the equation it 
is reasonable to expect that it does not stop and, in fact, the solution 
is expected to be periodic. So, we would like to know if it is possible 
to show that the solution is periodic, and in the process determine the 
period without actually solving the problem. 


5.1 » Non-Linear Systems 


The problems in this chapter can be written in component form as 


ul’ = f(u,v), (5.4) 
5) 


v' =g(u,v). 
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In these equations, u(t) and u(t) are the dependent variables, and f and 

g are given functions of u and v. It is assumed that the equations are 

autonomous, which means that f and g do not depend explicitly on t. 
The vector form of (5.4), (5.5) is 


Y = ty), (5.6) 


_ f(u - 7 f(u,v) 
v=("): i (ween) 


For an initial value problem, an initial condition of form 


y(0) = ("") . (5.7) 
v0 


Example: For the nonlinear system 


where 


would also be given. 


u=vU-— U4, (5.8) 


1 
v= —5v + 2u(2 — u*), (5.9) 


_ v—5uU 
- —5u + 2u(2—u?) } 


There are no known simple mathematical methods that can be used 
to find the solution of this system (by hand). However, it is easily 
solved using a computer, and four example curves are shown in 
Figure 5.2. In all four cases, the solution ends up at one of two 
points. In this chapter we will not attempt to find the solution 
curves but we will be very interested in determining these two points 
and finding the reason why the solution approaches them. & 


we have that 


v-axis 


Figure 5.2. Solution curves of (5.8), (5.9) in the u,v-plane for four different 
initial conditions (shown with the solid dots). The arrows indicate the direction for 
increasing t. 
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5.1.1 » Steady-State Solutions 


For y’ = f(y), a steady state solution y, is a constant vector that 
satisfies f(y;) = 0. In component form, the requirements are that 


f(us ) = 0, ( 0) 
g(us ) = 0. ( 1) 


Solving for us and vs is not straightforward. In fact, given that f(u,v) 
and g(u,v) can be almost anything, there is no method that always works 
for solving these equations. The recommendation is to pick one of the 
equations, and use it to solve for u in terms of v, or v in terms of u. The 
equation to pick for this is usually the one that is easiest to solve. This 
solution is then substituted into the other equation, and you then have 
one equation and one unknown (see Example 1). It is also not uncommon 
that you need to be opportunistic, and take advantage of certain terms 
in the equation to help simply the equations (see Example 2). 


» Us 5.1 
» Us 5.1 


Example 1: Find the steady states of 


d 

an U-—V— Uv, 
d 

pm we 


Answer: The equations to solve are 


3-—u-—v—-—uw=), 


uv — 2v = 0. 


The second equation looks the easiest to work with. Factoring it as 
v(u — 2) = 0, we get two solutions: v = 0 and u = 2. Taking v = 0, 
then from the first equation we get that u = 3. For u = 2, from the 
first equation we get that v = 1/3. Therefore, we have found two 
steady states: (us,Us) = (3,0), and (us,vs) = (2,1/3). 


Example 2: Assuming a is a positive constant, find the steady states of 


d 

a= 1 +a)u+w, 
d 

qa un we. 


Answer: The equations to solve are 


1-—(1+a)u+u7v =0, 


u—u-v =0. 
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It is possible to use the approach from the previous example, but it 
is easier to look a little closer at these equations. They both contain 
the term u?v. In fact, from the second equation u?v = u. Using this 
information in the first equation, we get that u = 1/a. From the 
second equation, it follows that v = a. Therefore, we have found 
that the only steady state is: (us,vs) = (1/a,a). lf 


Example 3: Find the steady states of 


! 2 
C= eee — £y; 


y’ = 2y — y* — 3ay. 
Answer: The equations to solve are 


2 —2*— xy =0, 


Qy — y* — 3xy = 0. 


Factoring the first equation as z(1—x—y) = 0, then either x = 0 or 
x=1-y. If  =0, then from the second equation y = 0 or y = 2, 
giving us the two steady states (0,0) and (0,2). When x =1-y, 
the second equation reduces to y(1 — 2y) = 0, which has solutions 
y = 0 and y = 1/2. This gives us two more steady states, which are 
(1/2,1/2) and (1,0). 


Example 4: For the system 


the steady states are any points that satisfy y=az. IH 


Example 5: The system 


g=aty, 
wh, 


does not have a steady state solution because it is not possible for 
/ 
y =0. 


We are going to avoid the situation in Example 4. Specifically, in 
the problems we will consider, there can be multiple steady states, but 
they are discrete points as in Examples 1, 2, and 3. The way this will be 
stated is that the steady states are isolated, which means that there is a 
nonzero distance d so that the distance between any two steady states for 
the problem is at least d. 


Exercises 
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1. Write the following as y’ = f(y), making sure to identify the entries in 
y and f. If initial conditions are given, write them as y(0) = yo. 


a)w =w—v 


vu’ = 2u — 3 
b) uf = u? + v2 
2v’ = sin(u) 
c) u =et—v 
vu = uw 
u(0) = 1, v(0) =0 
d) Van der Pol oscillator 
vu" + (1—u?)u’ +u=0 
e) Toda oscillator 
u’+e"—-1=0 
f) Duffing oscillator 
uv’ tu+tu=0 
u(0) = 1, u’(0) = —-1 


g) Michaelis-Menten system 
S’ = —k ES + k_1(£o — £), 
Ee = —k, ES+(ko+k_1)(Lo—-E) 
S(0) =1, E(0) =2 


h) Predator-prey 
x’ =ax — bry 
y =—cy+dzy 
i) Projectile (nonuniform field) 
2 
” gk 


j) Orbital motion 


2 
ll ee ol 
r3 2 
nO 15 (02 


2. Find the steady state solutions of the following. 


uv! = 3uv — 


ae, 
ee u 


u’ =1—2u—v—uv 
a) 


v =vtu3 
uw =4— wu? 
c 
vl =-—v+uv? 
_ 2 2SP 
y 
p’ = 28P _ p 
, { #= 1845-18 
ea ee ces 


5.2 « Stability 


8) yf = By? + 2+ 

g=xy 
_ y =(2—-a2—-y)(1+y) 
i) v =2(4—2-y) 

y = y(6—y — 3a) 


The question considered now is central to this chapter, and it is whether 
a steady state is achievable. What this means is that the steady state is 
asymptotically stable. To explain how we are going to determine stability, 
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y-axis 


“2+ 
-4 5 


X-axis 


Figure 5.3. Solution of (5.12),(5.13) for different initial conditions. The 
blue curve approaches the steady state (1,0), while the red curve approaches the steady 
state (0,2). 


consider the problem of solving 


a’ =x — 2" — ay, (5.12) 


y’ = 2y — yy? — 3ay. Gals 


This is the problem from Example 3 in the previous section, and we found 
that there are four steady states: (0,0), (0,2), (1,0), and (1/2,1/2). One 
approach for providing insight about stability is to solve the problem 
numerically. This is easy to do, and two computed solution curves are 
shown in Figure 5.3. The four steady states are also shown, using black 
circles and squares. The curves are consistent with what is expected if 
(0,2) and (1,0) are asymptotically stable. Also, since both curves start 
near (0,0), yet move away from it, it would not be a surprise to find out 
that (0,0) is an unstable steady state. 

Solving the problem numerically is so easy that it possible to solve the 
problem for many different initial conditions, and check if the solution 
approaches one of the various steady states. The results from such a 
calculation are shown in Figure 5.4. What is found is that there are, 
apparently, two asymptotically stable steady states, (0,2) and (1,0). The 
calculations also identity the regions for the initial conditions that result 
in the solution ending up at the respective steady state. The two regions 
determined from this computation are called the domain of attraction for 
the respective steady state. It also needs to be pointed out that initial 
conditions located in the white region (approximately the third quadrant 
in Figure 5.4), produce solutions that do not approach a steady state. 
In this example they simply become unbounded, but in other nonlinear 
problems you can get interesting solutions like limit cycles or strange 
attractors. 

Our goal is not to be able to determine the shaded regions shown 
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x-axis 


Figure 5.4. An initial condition (x(0), y(0)) located in one of the shaded 
regions results in the solution of (5.12),(5.13) ending up at the steady state in that 
shaded region. The two steady states are shown by the dark circles. 


in Figure 5.4, but, rather, to show that there is a small region around 
the respective steady state with the same property as the shaded region. 
Namely, for any initial condition in that small region, the solution of the 
resulting IVP will end up at the steady state. In this case, the steady 
state is said to be asymptotically stable. What we are doing now is the 
two dimensional version of what we did in Section 2.4, and the nonlinear 
version of what was done in Section 4.7. 


5.2.1 » Derivation of the Stability Conditions 


The differential equation is y’ = f(y), and this can be written in compo- 
nent form as 


u' = f(u,v), (5.14) 


v' = g(u,v). 5.15 


Assume that (us,vs) is a steady-state, which means that u, and v, are 
constants that satisfy 


flue, )=0, 
= 0. 


Us 
g(us, Us) 


The reason for considering stability comes from this question: If we start 
the solution near (us, vs), what happens? 

There are three possible conclusions coming from this question: the 
steady state is unstable, it is asymptotically stable, or it is neutrally 
stable. What these are can be explained using a ball and bow! (see Figure 
5.5). The force on the ball is gravity. For the bowl, the steady state is at 
the bottom, and for the inverted bowl it is at the top. For the inverted 
bowl, if you release the ball from rest, no matter where you place it (other 
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Figure 5.5. Ball in a bowl, on the left, and a ball on an inverted bowl, on the right. 


than exactly at the top), the ball will roll away. The conclusion is that 
the steady state is unstable. For the bowl, you can control how far the 
ball will get from the steady state (the bottom) by placing it close to 
the bottom and giving it only a small initial velocity. Consequently, the 
steady state is stable. Because the only force is gravity, the ball will roll 
around in the bowl forever. This means the steady state is neutrally 
stable. If the problem also includes damping, such as friction, then the 
ball will slow down and eventually come to rest at the bottom. In this 
case the steady state is asymptotically stable. Note that including 
damping for the inverted bow] will not change the fact that the top is an 
unstable steady state. 

For those that prefer a more mathematical definition, the idea under- 
lying asymptotic stability is that if y(0) is any point close to the steady 
state ys, then 


Jim y(t) = ys. (5.16) 
As stated above, a steady state is stable if you can control how far the 
solution gets from y, by picking y(0) close to y,;. Specifically, given any 
é > 0, youcan finda dé > 0so that if ||y(0)—ys|| < 4, then ||y(t)—ys]|| < e. 
If this is not possible then y, is unstable. The key word here is “any.” 
For stability, any y(0) satisfying ||y(0) — ys|| < 6 must work, while for 
instability there just needs to be one y(0) that satisfies ||y(0) — y.|| < 6 
but ||y(t) — ys|| < € is not satisfied. If y, is stable, and (5.16) holds, then 
it is asymptotically stable. Otherwise it is said to be neutrally stable. 
Note that this version of the definition of stability requires that wu and v 
have the same physical dimensions so that ||y|| = Vu? + v? is defined. 


Linear Approximation 


To answer the stability question, assume that the initial position (u(0), v(0)) 
is very close to (us,vUs). To determine what happens, we will use what 
is called the linear approximation in multivariable calculus. This states 
that if f(u,v) and g(u,v) are differentiable at (us, vs), then each can ap- 
proximated using their respective tangent plane. In particular, 


f (u,v) x Fes Us) + Fulitss Ue) (UB _ sy) ac Fol tis, 5 (0 = Us); 
G(s, Us) + gu(Us, Us)(U — Us) + Ju(Us, Us)(U — Us). 


© 

£ 

= 
2 


128 


Chapter 5. Nonlinear Systems 


In the above expressions, fi, = of ‘a of Ju = 84 Gv = 84 It should 


be pointed out that this approximation is also a direct consequence of 
Taylor’s theorem, and this can be used to derive more accurate approxi- 
mations if needed. 

By assumption, f(us,vs) = 0 and g(us,vs) = 0. Consequently, the 
linear approximation of (5.14) and (5.15) near the steady state is 


(us, Us) (u os Us) a ities, Us) (v — Ve), 


= Ju(Us, Us)(U — Us) + Gu(Us, Us)(V — Us). 


ef 
I 
= 


This can be written in system form as 


y =I.(y —ys), (5.17) 


where 


and 


ee ae oe 


GulUs,Us)  Gu(Us, Us) 


The matrix J, is known as the Jacobian matrix of f evaluated at ys. 
To put the problem into the form covered in the last chapter, let 
x=y-ys. With this, (5.17) becomes 


x’ = Ax, (5.18) 


where A = J,. The general solution of this is given in Section 4.5. For 
what we are doing it is not necessary to distinguish between real or com- 
plex valued eigenvalues. Using the formulas in Section 4.5, and remem- 
bering that y = y, + x, we conclude that if J, is not defective, then 


y =ystcyaye”™* + coage™’, (5.19) 
and if it is defective, then 
y =yst+cae™ + co(ta+ b)e™. (5.20) 


Whether the e™ terms in (5.19) or (5.20) go to zero, or blow up, as 
t — co, depends on whether Re(r) is positive or negative. To determine 
this, it is easiest to go through the various possibilities individually. 


e Ifall of the eigenvalues of J, satisfy Re(r) < 0, then the exponentials 
in (5.19) and (5.20) go to zero as t + oo. So, ys is asymptotically 
stable 
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e If one, or more, of the eigenvalues of J, satisfies Re(r) > 0, then 
at least one of the exponentials in (5.19) and (5.20) blows up as 
t > co. So, ys is unstable. 


There is a notable hole in the above list in that there is no conclusion 
for the case of when both eigenvalues are imaginary. As explained in 
Section 4.7, for a linear problem this leads to the conclusion of neutral 
stability. There are neutrally stable steady states for nonlinear systems, 
as illustrated with the ball and bowl example earlier, but the linear ap- 
proximation is inadequate to determine this. 

As a final comment, the only assumption needed to guarantee that the 
above conclusions hold is that the first and second partial derivatives of 
f(u,v) and g(u,v) are continuous. Those interested in a mathematically 
rigorous proof of this should consult Stuart and Humphries [1998] or Perko 
[2001]. 


Phase Plane 


The above derivation for the stability conditions can provide us with in- 
formation about the solution curves near a steady state. The reason is 
that the reduced equation in (5.18) is the same one considered in the last 
chapter. This enables us, in certain cases, to apply the phase plane solu- 
tions shown in Table 4.1 (page 105) to the nonlinear system. To explain 
how, suppose you have a steady state that the above test determines is 
unstable or asymptotically stable. As stated earlier, we are only consid- 
ering isolated steady states, and to guarantee this happens it is assumed 
that r = 0 is not an eigenvalue of J,. Now, in the vicinity of the steady 
state, we have that y ~ y, + x. This means that the phase portrait for 
y is similar to one of those in Table 4.1, but it is centered at y = y,; 
rather than at x = 0. Which one is determined by the eigenvalues of J,. 
Demonstrations of this will be included in the examples that follow. 


5.2.2 « Summary 


For the nonlinear system 


the associated Jacobian matrix J is given as 


OF Oi: 
j- Ou Ov 
Og Og 


Ou Ov 
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The eigenvalues of J are used to determine stability, as explained in the 
next theorem. 


Linearized Stability Theorem. Given a steady state y,, and letting 
J, be the Jacobian matrix evaluated at ys: 


e If all of the eigenvalues of J, satisfy Re(r) < 0, then ys, is asymp- 
totically stable. 


e If one, or more, of the eigenvalues of J, satisfies Re(r) > 0, then 
ys is unstable. 


This assumes that the second partial derivatives of f(u,v) and g(u,v) are 
continuous at, and in the immediate vicinity of, ys. 


Not every possibility is included in the above theorem. As an example, no 
conclusion can be made when there are only imaginary eigenvalues. Any 
case that is not covered by the theorem will be referred to as indeterminate 
in this chapter. 

For those with good memories, there are a few easy to use shortcuts 
that avoid computing eigenvalues. If you are interested in what they are, 
see Exercise 6. 

It is worth pointing out that even though we are considering systems 
with two equations (so, n = 2), the above theorem holds when there are n 
equations. In fact, for n = 1 the above theorem reduces to the one given 
in Section 2.4.1 (page 35). 

Finally, if the above theorem determines that a steady state is un- 
stable or asymptotically stable, and r = 0 is not an eigenvalue, then the 
eigenvalues and eigenvectors of J, can be used to determine the phase 
portrait of the solution near the steady state. This is done in the same 
way as for the examples shown in Table 4.1. The principal difference now 
is that it is centered at y = y, rather than at x = 0. Therefore, the clas- 
sification of steady states into a source, sink, spiral source, spiral sink, 
or saddle, as given on page 114, is applicable to the nonlinear systems 
considered here. 


5.2.3 » Examples 


Example 1: Determine the stability of the steady states of 
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This is the system that produced the solution curves shown in Figure 
5.2. 


Step 1: Find the steady states. The equations to solve are 
27 =0 
v— 5 ; 
1 2 
~5¥ t 2u(2—u =o) 


From the first equation, v = u/2. With this the second equation be- 
comes u(u? — 15/8) = 0. Consequently, there are three steady states: 
(u,v) = (—2a,—a@), (0,0), (2a,a), where a = 30. 


Step 2: Determine the Jacobian matrix. 


Of of 
Ge: du Ov | —5 1 
| ag ag 2(2—3u?) —4)- 
du Ov 


Step 3: Check on the stability of each steady state. 


1 
= 4 
ees 2 
J; a = ‘) , 
4 2 


and this has eigenvalues r) = (—1 + iV29)/2 and r2 = (—1 — ivV29)/2. 
Since both satisfy Re(r) < 0, this steady state is asymptotically stable. 
In addition, since the eigenvalues are complex, and Re(r) < 0, the 
phase portrait near this steady state should be a spiral sink. To check, 
the region in Figure 5.2 that is near (2a,a) is shown in Figure 5.6. 
As expected, the solution curves spiral into the steady state, as they 
should for a spiral sink. 


(2a,a): In this case 


v-axis 


0.6 1 1.4 
u-axis 


Figure 5.6. Solution curves of (5.8), (5.9) in the u,v-plane near the steady 


state (2a,a) in Example 1. 
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_1l 1 
_ 2 
J,= ( 4 _1 o] 
2 


and this has eigenvalues rj = 3/2 and rp = —5/2 . Since r; > 0 then 
this steady state is unstable. Also, since rg < 0 < 71, then this is a 
saddle point and the phase portrait near (0,0) will resemble the one in 
Figure 4.1(b) or in Figure 4.3(b). 


(—2a,—a): In this case 
1 
= | 
2 2 
J; ns © = 9 
4 2 


and this has eigenvalues r; = (—1 + iV 29)/2 and re = (—1 + iV 29)/2. 
Since both satisfy Re(r) < 0, this steady state is asymptotically stable. 
As with (2a,q), this is a spiral sink. 


(0,0): In this case 


Example 2: Determine the stability of the steady states of 


! 2 
ur=xr-xUw—-zy, 


y’ = 2y—y" — 3ay. 
This is the system that produced the solution curves shown in Figure 


5.3. 


Answer: In Section 5.1.1, Example 3, we found that there are four 
steady states: (0,0), (0,2), (1/2,1/2) and (1,0). To determine their 
stability, the Jacobian is 


af af 
jez Ox Oy |. fla2e-y —x 
| dg ag | —3y 2—2y — 32 

Ox Oy 

(0,2): In this case 
irae —1 0 
me ae ee 
The eigenvalues are r; = —1 and rg = —2, and since they are both neg- 


ative, the steady state is asymptotically stable. Moreover, since both 
are negative, the phase portrait near this steady state will resemble 
those for a sink. Sketching the phase portrait was explained in Section 
4.6. Briefly, eigenvectors of J,, for r; and rg are, respectively, 


_(-1 eres 
ay = 6 5 an. ag = l : 
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2.1 


y-axis 
nD 
T 
| 


-0.02 0 0.02 
x-axis 


Figure 5.7. Phase portrait near the steady state (0,2) for Example 2. 


The two red lines shown in Figure 5.7 are determined by these eigen- 
vectors. The arrows point toward the steady state as both eigenvalues 
are negative. Typical integral curves are shown in blue. The result is 
a phase portrait for a sink. 


J —1/2 -1/2 
oN ea, “24/2) 
and this has eigenvalues r, = (—1+/3)/2 and rp = (—1— V3) /2. Since 
r, > 0, it follows that this steady state is unstable. As for the phase 
portrait near this steady state, since rg < 0 < r, then this steady 


state is a saddle point. To sketch the phase portrait, the eigenvectors 
of J;, for r, and rg are, respectively, 


13 1/3 
a =( or and 0 = (7), 


The two red lines determined by these vectors are shown in Figure 
5.8. Typical integral curves are shown in blue. So, the curves have the 
pattern expected for a saddle. 


(1/2,1/2): In this case 


Determining the stability of the remaining two steady states is left as 
an exercise. IH 


Example 3: As introduced at the beginning of the chapter, a model for 
the spread of a disease, like measles, is 


ds 
Ge TON — (BE + aS, 
dl 
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0.52 
0.5 <a 
0.48 


| 
0.48 0.5 0.52 
x-axis 


y-axis 


Figure 5.8. Solution curves of Example 2 in the x,y-plane near the steady 
state (1/2,1/2). 


where N is the total number of individuals in the population (it is 
constant). The coefficients, a, 6, and 7, are positive constants. It is 
not hard to show that the two steady states are (S,J) = (N,0) and 
(S,I) = (Se, Ie), where 

a+y a 


e—- yp I, = 
S B and aa 


(N — Se). 


The first steady state, (V,0), corresponds to the case of when the dis- 
ease is eliminated, and everyone ends up in the S group. The other 
steady state, (S.,J.), is an example of what is known as an epidemic 
equilibrium, and this is something that is usually avoided if at all pos- 
sible. Said another way, we want this steady state to be unstable. 


To determine the stability of the steady states, note that 


Of of 

y_{ 9S af | _ (-(6l+a) BS 
ag Og BI BS— (a+) 
OS Ol 


(S,I) = (N,0): In this case 


it et 
( ae 


The eigenvalues of this matrix are —a and 6(N — S.). Therefore, if 
N < S¢, then this steady state is asymptotically stable, and if N > S:, 
then it is unstable. 


(S,I) = (Se, I-): One finds that this steady state is unstable if N < S¢, 
and it is asymptotically stable if N > S.. 
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Measles: In the study of infectious diseases it is conventional to intro- 
duce a variable Ro, where Ro > 1 means the epidemic steady state is 
asymptotically stable, and it is unstable if Ro < 1. For our problem, 
Ro = N/Se, which means that 


BN 
aty: 


Ro = 


The parameter qa is the birth rate in the population and 7¥ is associ- 
ated with the rate at which people get well. As for 6G, it reflects how 
contagious the disease is (a larger 3 means it is more contagious). For 
measles, a = 1/50, y = 100, and 8 = 1800/N [Engbert and Drepper, 
1994], in which case Ro + 18. This is far from having Ro < 1, and this 
is a reflection of the fact that measles is one of the most contagious 
diseases known. As a final comment, in this problem, an unstable epi- 
demic steady state means that the solution will approach the disease 
free steady state. However, this does not necessarily happen for other 
nonlinear systems. Determining this requires information about the 
domain of attraction for the steady state, which was discussed at the 
beginning of this section. MH 


Exercises 


1. For the following find the steady states, and then determine whether 


they are asymptotically stable, unstable, or indeterminate. Also, ex- 
cept for the indeterminate cases, state whether the steady state is a 
sink, source, spiral sink, spiral source, or saddle. Any parameters ap- 
pearing in the equations should be assumed to be positive. 


aa /—~ ge 2 
xe U a UU 


uv =utv3 vw =—v+ uw" 


U=VU—-U 


v =vtu3 


gi =ag*-y g=ar*+y 
Oe h) frend 

y = 2x — 3y 2y = sina) 
S'=-2ES+E)-E 

E! = —2E§ + 2(Ep — E) 


uw =1—2u—v—uv 


uv! = 3uv — v 
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ae r S'=-3I18+1-I-S 
m 
y =-cy+dry '=318—1 
" S! = 25 — §? — 38F 2) r’ =(r—1)(s +2) 
pl = BF — Pp s' = —(r+1)(s +3) 


. For the following: (i) find the steady state, (ii) find the linear approx- 


imation of the system near the steady state, and then (iii) sketch the 
phase portrait in the vicinity of the steady state as follows: draw the 
(red) lines that are determined from the eigenvectors of J,, including 
the arrows for these lines, then in each of the four quadrants deter- 
mined by the red lines, include two integrals curves, with arrows. 


ue =v-4u ul =4—w’? 
a) Eis < 


v=vtu vw =v tu? 
b) u=l+uv a) S'’=-2ES+E,)—E 
v=utr? E! = —2ES + 2(Ep — E) 


. Graphically locate the steady states in the x,y-plane. Also, determine 


whether they are asymptotically stable, unstable, or indeterminate. 


g=a?+y?—-4 b) g=-yt+s 
a 
y =-yt+a y' = y — cos(z) 


. Each nonlinear system produces one of the four plots in Figure 5.9. 


Determine which system goes with which plot. Make sure to explain 
why. 


ON ee ae nee 


y =2-y-2 y =22+y-2 

xe =2(x2—- vg =2x(y—2 
ga ( y nip ea fy ) 

y =2-y-2 y=aty-2 


. Suppose that y = Y is a steady state solution of y” + cy’ + g(y) = 0. 


So, y=Y is a constant and g(Y) =0. 


a) Show that Y is unstable if c < 0. 
b) Suppose that c > 0. Show that Y is asymptotically stable if g/(Y) > 
0, and it is unstable if g/(Y) < 0. 


. In this problem, assume that 
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Figure 5.9. Solution curves for the systems in Exercise 4. The colored dot 
is the initial condition. 


The trace of a matriz is the sum of the numbers on the diagonal. The 
formula is tr(J;) =a+d. Also, the determinant is det(J,) = ad — bc. 


a) Show that the eigenvalues of J are 3 [tr(J,)+ J [tr(Js)]? — 4det(Js)). 
b) Show that if tr(J,) > 0, then y, is unstable. 


c) Show that if det(J,) < 0, then y, is unstable. 


d) Show that if det(J,) > 0 and tr(J,) < 0, then y, is asymptotically 
stable. 


7. A model for how a joke moves through a population involves three 
groups: S is the population that either has not heard the joke, or does 
not remember it, J’ is the population of those who know the joke and 
they will tell it to others, and R is the population who know the joke 
but will not tell it to others (they are not good joke tellers or they 
don’t think it’s all that funny). As shown in Holmes [2019], 


< = —20ST + B(N — $), 
aT 
o = aST — BT 


where N is the total number of individuals in the population (it is 
constant). The coefficients a and £6 are positive constants. Also, once 
S and T are determined, then R= N—-—T-—S. 


a) There are two steady states, what are they? 


b) One of the steady states has T = 0. When is it asymptotically 
stable? 
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c) One of the steady states has T 4 0. When is it asymptotically 
stable? 

d) The a is the telling parameter, so a larger a means the joke is 
being told more often. Similarly, 6 is the forgetting parameter, so 
a larger 6 means the joke is being forgotten faster. Based on your 
answers from parts (b) and (c), under what conditions will the joke 
disappear from the population? 


5.3 » Periodic Solutions 


With the stability test derived in the previous section, we have a fairly 
good tool for determining if, and when, the solution of a nonlinear system 
will come to rest. The next question concerns what can be learned about 
periodic solutions. This is needed as periodicity plays an important role 
in our lives, and examples are the sleep-wake cycle and the periodic events 
associated with the Earth’s rotation. 

To begin, it’s best to define what is meant by periodicity. A solution 
of y’ = f(y) is periodic if there is a positive number T’ so that 


y(t+T) =y(t), Vt>0. (5.21) 


The smallest positive T, if it exists, is the period. 

We will only consider problems that come from Newton’s second law. 
Specifically, if u(t) is the displacement, and F' is a function of u, then 
F = ma gives us the differential equation 


mu" = F(u). (5.22) 


Letting v = u’, then the above equation can be written in system form as 


ul =v, (5:23) 
C= ~ Fu). (5.24) 


It is not hard to show that if u(t) is periodic with period T’, then the 
velocity u(t) is also periodic with period T. Consequently, (5.21) is sat- 
isfied, and so the solution is periodic. Examples of what are, or are not, 
periodic are explored in more depth in Exercise 3. 

We will first find a way to determine the solution curve in the phase 
plane directly from the differential equation and initial conditions. Once 
that is done, we will then be able to determine the period T,, as well as 
other properties of the solution. 


Example: Mass-Spring 


In Section 3.10, it was shown that the displacement u(t) of a mass in 
a spring-mass system satisfies mu’ + ku = 0. The general solution of 
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= 


v-axis 
So 


29 -1 0 1 2 
u-axis 


Figure 5.10. Elliptical path, given in (5.26), that is followed by the solution 
of the mass-spring IVP. The blue dot is the location of the initial condition. 


this equation can be written as u = Reos(wot — y), and v = uw’ = 


—woRsin(wot — y), where wo = \/k/m. Consequently, the solution is 
periodic, with period T = 27/wo. The key observation here is that, using 
the identity cos? @ + sin? 6 = 1, 


or equivalently 
1 
uw? +— 0" = R?. (5.25) 
my 
This is an equation for an ellipse in the u,v-plane. As an example, suppose 
that m = 1, k = 4, and the initial conditions are u(0) = 1 and v(0) = 0. 
In this case, u = cos(2t), v = —2sin(2t), and from (5.25), the ellipse is 


1 
u? + ra = 1, (5.26) 


This curve is shown in Figure 5.10. Because the period is T’ = 7, the 
solution goes around the ellipse and returns to the starting point (1,0) at 
t=7, 27, 37,.... 

To see what can be learned from the system form of the problem, the 
equations are 


vy! = —weu. 


This can be used to determine the direction of the arrows in Figure 5.10. 
Since v’ = —wéu, using the initial condition given earlier, v'(0) = —wé. 
The fact that this is negative means that v must decrease as it leaves 
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the initial point, and so the direction of motion is clockwise around the 
curve. Note that it is not possible for the solution to reverse direction on 
the curve because this would require that there is a point on the curve 
where u’ = 0 and v’ = 0. Such a point corresponds to a steady state, and 
the only steady state for this problem is the origin. 


The important conclusion coming from the above example is that, 
no matter what time ¢ you select, the solution is located somewhere on 
the curve shown in Figure 5.10. Having a closed curve like this is a 
requirement for the solution to be periodic. The reason is that a solution 
traces out a curve in the phase plane, whether the solution is periodic or 
not (see Table 4.1 for examples). For the solution to be periodic, it must 
return to its original position, and that is why a closed curve as in Figure 
5.10 is required. What is shown below is how to determine this curve 
without actually knowing what the solution is. 


5.3.1 » Closed Solution Curves and Hamiltonians 


It is possible to find the equation for the closed curve without too much 
trouble if the differential equation comes from Newton’s second law, F = 
ma. To explain, if u(t) is the displacement, and F is a function of u, then 
F = ma gives us the differential equation mu” = F(u). Multiplying this 
by the velocity u’, and remembering that v = u’, we get that 


mov’ = F(u)u’. (5.27) 


The key is to observe that the left hand side can be written as 


als") 

dt \2 

To do the same for the right hand side, let V(w) be such that V’(u) = 
—F(u). In this case, the right hand side of (5.27) can be written as 


dV du d 


Fiau'= = 
(aye ide ae 


What we have done is to rewrite (5.27) as 


dl 
a (me + V(u)) = 0. (5.28) 
Integrating this equation, 


1 
5m +V(u)=c. (5.29) 


The value of the constant c is determined from the initial conditions. 
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There is a physical interpretation of the equation we have derived that 
is worth knowing about. The left hand side of (5.29) is 


Oe sv? + V(u). (5.30) 


This function is a Hamiltonian for the differential equation. In this in- 
stance it is the total mechanical energy of the system, and it consists of 
the sum of the kinetic energy, 5mv" , and a potential energy, V(u). What 
we have shown in (5.29) is that the total energy is constant. So, the solu- 
tion moves along a constant energy curve determined by the Hamiltonian 
and the initial conditions. 

Not every forcing function F'(u) will result in (5.29) being a closed 
curve. Moreover, it is typical that when F'(u) is nonlinear, that not all 
initial conditions, if any, will yield a closed curve. Examples of these 
situations are given below. 

Finally, as is often the case in mathematics, it is not recommended that 
you memorize the formula given in (5.29). It is better that you remember 
how it is derived. Namely, you multiply the second-order equation by the 
velocity, and then rewrite the terms as derivatives. 


Example: Mass-Spring Revisited 
Starting with the equation 
mu" +ku=0, 
we multiply by u’ and obtain 
mov’ + kuu’ = 0. 


This can be written as 


Gf l-. ocho 
This means that 


1 1 
xe + shu =" 


where c is an arbitrary constant. Taking, as in the last example, u(0) = 1, 
v(0) = 0, m = 1, and k = 4, and substituting these values into the above 
equation we find that c = 2. Consequently, the above equation becomes 


1 
a+ ae =i, (5.31) 


This is exactly the same equation (5.26) we derived earlier using the 
known solution to the problem. What is significant is that we have found 
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this curve without first finding the solution of the problem. MH 


It was mentioned earlier that not every forcing function will result in 
a closed curve. For the above mass-spring problem the spring force is 
F = —-km. This is attractive, in the sense that it pulls the mass back 
towards the rest position u = 0. If the force is repelling, so F = km, 
then instead of (5.31), you get u? — iu" = 1. This is an equation for a 


hyperbola, which is not a close curve. 


Example: Pendulum 


The equation for the angular deflection of a pendulum can be written as 


d?0 


qo sin 0. (5.32) 


where a = g/€. Introducing the angular velocity v = 6’, then we obtain 
the first-order system 


Of =v, (5.33) 
v' =—asiné. (5.34) 
In this example, assume that a = 4, and that the initial conditions are 


6(0) = 7/4 and v(0) = 0. To determine the closed solution curve, we 
multiply (5.32) by the velocity v = 6’, giving us 


vv’ = —46' sin 0. 
Writing this as 
dl, d 
eile Bete | 
Ha” ak cos 8), 


and then integrating gives us the equation 
1 5 
-—v" —4cos0 =c. 
5Y co 


With the initial conditions we find that c = —2V2, and so the equation 
for the curve takes the form 


v? — 8cos6 = —4V2. (5.35) 


The curve obtained from this equation is shown in Figure 5.11. 

The direction of the arrows can be determined from the v’ equation 
(5.34). Namely, since v’(0) = —asin(0(0)) = —2V2, and this is negative, 
then v must decrease as it leaves the initial point. Therefore, the direction 
of motion is clockwise around the curve. 
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Figure 5.11. Path followed by the solution of the pendulum example. 


t-axis 


Figure 5.12. Solution curves for 0(t) and v(t) for the pendulum solution 
shown in Figure 5.11. 


It is possible to determine various properties of the solution from 
(5.35). For example, the maximum velocity vj occurs when v’ = 0. 
Since v’ = —4sin 6, then from Figure 5.11 it is apparent that the only 
solution is 6 = 0. In this case, from (5.35), v? = 4(2 — V2). Therefore, 
um =2V2- V2. 

Finally, to illustrate the periodicity of the individual components of 
the solution, both # and v are plotted in Figure 5.12 as functions of t. 
An interesting question is whether it is possible to determine the period 
of these functions without knowing the solution. It is, and how this is 
possible will be explained in the next section MH 


Example: Librating versus Circulating Motion 


For a pendulum, if the initial velocity is large enough, then the mass will 
go all the way around, pass through @ = z (or, 6 = —7) and return to 
where it started. It will continue to do this indefinitely. This motion is 
periodic, but it does not satisfy the definition of a periodic solution given 
in (5.21). In mechanics it is called a circulating, or rotating, motion. In 
contrast, the tick-toc type of periodic motion considered in the previous 
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example is referred to as libration. 

The integral curves for the pendulum are shown in Figure 5.13. The 
closed, solid blue, curves correspond to the periodic solutions discussed 
earlier. The dashed curves are some of the possible circulating solutions. 
On these curves, the angular coordinate @ increases monotonically if v > 0, 
and decreases monotonically if v < 0. In the physical plane this corre- 
sponds to the mass continually making complete circuits around the pivot 
point (i.e., it is making a circulating motion). 

The red curves in Figure 5.13 form what is known as the separatriz 
for the pendulum. If you start at a point on the separatrix, the solution 
will approach the vertical, unstable, steady state. 


5.3.2 » Finding the Period 


Once the closed curve formed by the periodic solution is known, it is 
possible to find the period. As usual, it is easiest to explained how this 
is done using examples. 


Example: Mass-Spring 


The equation for the curve is given in (5.31). Solving this for v yields v = 
+2V/1—u?. Which sign you use depends on what part of the curve you 
are considering. In Figure 5.10 the two u intercepts are u = +1. So, for 
the lower part of the curve connecting (1,0) to (—1,0), v is negative, and 
so v = —2V1—u2. Since v = u’, then we have the first-order differential 


equation 

d 

a = 2/1 — wv. 
This equation is separable, which yields 


[ota [1 


Figure 5.13. Phase portrait for the pendulum equations (5.83), (5.84), when a = 4. 
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Carrying out the integrations, 
arcsin(u) = —2t+c. 


Given that u=1 at t = 0, then c= 7/2. 
To determine the period, we solve the above equation for t to obtain 


lsa ‘ 
oe (= — aresin(u)). 
2\2 


It is now possible to determine how long it takes for the solution to move 
along the lower half of the curve and arrive at (—1,0). Namely, letting 
u = —1 in the above equation we get that 


1 
{= 5(5 — aresin(—1)) = = 


To compute the time to transverse the upper part of the curve, you can 
either use the separation of variables approach or you can use the sym- 
metry of the solution curve. Both yield the result that the time is 7/2. 
Therefore, the period is the sum, which means that T = 7. This agrees 
with what we found earlier using the exact solution to the problem. MH 


Example: Pendulum 


The equation for the curve is given in (5.35). Solving this for uv yields 


v = £2V/2cos@— V2. The lower part of the solution curve, shown in 
Figure 5.11, goes from (7/4,0) to (—7/4,0). On this part of the curve 


v = —2\/2cos 6 — V2, which gives us the first-order differential equation 


dé 
— = —21/2 —v2. 
a \/ 2cos0 V2 


This equation is separable, which yields 


= —2t+c. 


| Fm 


In anticipation of imposing the initial condition, the above integral is 
written as 


a dr _ 
09 VW 2cosr — J/2 


Now, given that 0(0) = 7/4, then 09 = 1/4 and c = 0. The above 
equation then takes the form 


2t+c 


[ dr 
= —2t. 
7/4 \/2cosr — V2 


146 Chapter 5. Nonlinear Systems 


The time to reach 9 = —7//4 is therefore 


1 77/4 dr 
t=-- 


2Jn/a /2cosr — V2 
i ac dr 
ae 2cosr —/2- 
Using the separation of variables approach, or using the symmetry of the 


solution curve, the time to transverse the upper part of the curve is the 
same as the above value. Therefore, the period T for the pendulum is 


7/4 
f ; a . (5.36) 
—7r/4 f/2cosr — a2 


So, we have a formula for the period that does not require knowing the 
solution. The complication is that it is an improper integral, of the type 
often referred to in a calculus textbook as “Type II,” which means the 
integrand becomes infinite at the endpoints. It is not possible to carry out 
the integration in terms of elementary functions, but it is easy to evaluate 
it using a computer. Doing so, one finds that T = 3.267.... I 


We have been able to determine a great deal about the properties 
of a periodic solution, without actually knowing what the solution is. 
As stated earlier, this is significant as most of the nonlinear problems 
that give rise to a periodic solution can not be solved explicitly using 
elementary functions. Consequently, they are almost always solved nu- 
merically. Our results complement what can be learned numerically, as 
we have been able to derive analytical formulas for the period, the closed 
curve, and other components of the solution. This makes it much easier 
to determine how the solution changes when the initial conditions, or the 
parameters appearing in the equations, are changed. 


Exercises 


1. Find a Hamiltonian function H(u,v) for each of the following. 


a) 2u” + 3e7* -3 =0 c) 5u” + 7u + 6u9 = 0 
u 
bet eee d) uw” + 4uV/1+u? =0 


2. It is common to define the potential energy relative to a steady state 
solution u = us. This means that the arbitrary constant in the po- 
tential energy is determined so that V(u,) = 0. For the equations in 
Exercise 1, what is the kinetic energy and the potential energy relative 
to the steady state? 
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3. This problem considers periodic, and non-periodic, solutions of y’ = 


f(y). 


a) Explain why any steady state is a periodic solution of this equation. 


b) Suppose that y», given below, is a solution. Is it a periodic solution? 


c) Suppose that y,., given above, is a solution. Is it a periodic solution? 

d) Show that if u(t) is periodic with period T, then v(t) = u’(£) is also 
periodic with period T. 

e) Suppose that v = u’. Give an example where v(t) is periodic, but 
u(t) is not periodic. 


. In this problem assume that the curve coming from (5.29) has the form 


shown in Figure 5.14. Also, assume u = u, is a steady state value. 

a) Explain why the maximum, and minimum, velocity occurs when 
u = us. How many steady states are there for this problem? 

b) Use the fact that there are two u-intercepts to explain why it is not 
possible that V(u) = u?. 

c) If F’(us) < 0, explain why V(u) has a local minimum at u = us. 

d) Using what you learned in parts (a)-(c), sketch V(u). In doing this 
assume that F’(us) < 0 and V(us) = 0. 


. The problem concerns a Duffing oscillator, and the differential equation 


is u’+u+u? = 0. Assume the initial conditions are u(0) = 1 and v(0) = 
0. This equation comes from a mass-spring system, as shown in Figure 
3.2, where the restoring force of the spring is nonlinear (specifically, 
it’s cubic) rather than the linear form assumed using Hooke’s law. 


a) The path followed by the solution is shown in Figure 5.15. Find the 
equation for this closed curve. 


b) Find the steady-state, show that it is not on the curve you found 
in part (a). 


v-axis 
o 


u-axis 


Figure 5.14. Path followed by the solution for Exercise 4. 
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Figure 5.15. Path followed by the solution of the Duffing oscillator in Exercise 5. 


c) Draw arrows on the curve indicating the direction of motion. Make 
sure to explain how you determine this. 

d) What is the maximum velocity? 

e) What is the minimum displacement? 

f) Find a formula, similar to the one in (5.36), for the period. 


. The problem concerns what is known as a Morse oscillator, and the 


differential equation is 
u” +2(1— e es =0. 


Assume the initial conditions are u(0) = 1 and v(0) = 0. This equation 

arises when studying the vibrational energy of a diatomic molecule. 

a) The path followed by the solution is shown in Figure 5.16. Find the 
equation for this closed curve. 

b) Find the steady-state, show that it is not on the curve you found 
in part (a). 

c) Draw arrows on the curve indicating the direction of motion. Make 
sure to explain how you determine this. 

d) What is the maximum velocity? 

e) What is the minimum displacement? 

f) Find a formula, similar to the one in (5.36), for the period. 


v-axis 
o 
T 
! 


ft 
0 
u-axis 


Figure 5.16. Path followed by the solution of the Morse oscillator in Exercise 6. 
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7. This problem concerns the generalization of the Hamiltonian to the 
general system in (5.4), (5.5). Assume that there is a function H(u, v) 


so that oH ae 
oy f(u,v) and aa —g(u,v). (5.37) 


Also, assume that f and g are smooth functions of u and v. 


a) Explain why (5.37) requires that f,, = —g,. If this holds then (5.4), 
(5.5) is said to be a Hamiltonian system. 

b) Show that the H(u,v) given in (5.30) satisfies (5.37). 

c) Use (5.37) to show that LH = 0. So, H(u,v) = c, where c is a 
constant, and in this sense H(u,v) is a Hamiltonian for the system. 

2 


d) Find a Hamiltonian for uw’ = v* — u, vo’ =v — 2u. 


e) Under what condition is the linear system y’ = Ay, where 


a Hamiltonian system? Assuming this holds, find H(u, v). 


5.4 » Motion in a Central Force Field 


The problem of interest concerns the motion in three dimensions of a 
particle that is subjected to a radial force F. The specific assumption is 
that 


F= F(r)x, (5.38) 


where x(t) is the position of the particle and r = ||x||.. From Newton’s 
second law, the resulting differential equation is 


mx" = “F(r)x, (5.39) 


where m is the mass of the particle. As for the initial conditions, it 
is assumed that the initial position x(0) = xo and the initial velocity 
x’(0) = vo are given. To avoid some uninteresting situations, it is assumed 
that xo X vo #0. 

The force F can be thought of as coming from the interaction with a 
particle located at the center. For example, if the force is gravity, then 
f(r) = —k/r?, where k = GMm. In contrast, if the particles are charged 
and the force is electrostatic, then f(r) = —k/r?, where k = —qQ/4m€0o. 
The definition of the various constants making up k is not important here, 
other than to know that it is possible for k to be positive or negative. In 
particular, it is positive for a gravitational force, and for an electrostatic 
force if the charges of the particles are opposite. It is negative for an 
electrostatic force if the charges of the particles are the same. 
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x 


Figure 5.17. A particle, the red dot, orbits a particle located at the origin. 
The orbit curve lies in a plane containing the origin and has normal n, where n is 
parallel to p = Xo X Vo. 


The solution of (5.39) can be shown to lie in a plane that has a normal 
vector n that is parallel to p = xo x vo (see Exercise 6). We will orient 
the coordinate system so the z-axis is in the n direction, which means 
that the solution of (5.39) is confined to the x,y-plane. To take advantage 
of this, we will use polar coordinates and write x(t) = r(t) cos@(t) and 
y(t) = r(t)sin@(t). After some routine change of variables calculations 
one finds that (5.39) reduces to 


mr” — r(6')?] = f(r), (5.40) 
dis 
—|r°(0")| =0. 5.41 

The last equation gives us that r?0’ = p, where p is a constant, and this 

means that the first equation reduces to 


mr” = f(r) + —. (5.42) 


This is a force balance equation, where f(r) is the force introduced earlier 
and mp?/r® is an outward directed force due to angular momentum. 

The second-order differential equation (5.42) can be written as a first- 
order nonlinear system by letting v = r’, giving 


r =e (5.43) 
1 p 
= ae 5.44 
vatyn+% (5.44) 
It is worth knowing that in the derivation of (5.42), it is found that 
p = ||Xo X vol]. So, p is a positive constant that is known from the initial 
conditions. 


5.4.1 » Steady States 


The steady states, if there are any, satisfy v = 0 and r? f(r) + mp? = 0. 
Assuming that f(r) = —k/r?, then to be a steady state it is required that 
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v-axiS 
o 

v-axiIS 
i) 


u-axis u-axis 


Figure 5.18. Two possible elliptical curves coming from (5.47). The u- 
intercepts for each ellipse are u— and uz. 


kr = mp*. This means we need k > 0, and the resulting steady state is 
r= Ts, where 
mp? 
ke 
Also, since r?6’ = p, then 0 = wt + 09, where w = k?/m?p*. The corre- 
sponding solution is a circular orbit in the x,y-plane, with radius r = r, 
and period 27/w. 

To check the stability, note that 


; 0 1 0 1 
= 2 = . 
Gone 2 =p jr, 0 


From this one finds that the eigenvalues are tip/r?, which means that the 
stability of the steady state is indeterminate using the Linearized Stability 
Theorem. 


rs= 


5.4.2 « Periodic Orbit 


The next question is whether the solution is periodic. Said another way, 
we would like to know if the particle orbits the particle that is located 
at the origin. To find the closed curve formed by the solution, if there is 
one, we multiply (5.42) by r’. From this, and remembering that we have 
taken f(r) = —k/r?, it is found that 


=mvu" + —> -- =¢, (5.45) 


where c is a constant determined by the initial conditions. Completing 
the square, we get that 


1 1\2 
wv +p*(- - —) =¢. (5.46) 


2 
where c2 = v3 + p?(1/ro — 1/rs) , 7(0) = 70, and v(0) = vo. 
To answer the question about a periodic orbit, it will make things 
easier if we let u=1/r. So, (5.46) takes the form 


2 
wtp? (u - us) =<, (5.47) 
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where us = 1/r,. This is an equation for an ellipse in the u,v-plane with 
center (u,v) = (us,0). Two representative elliptical paths obtained from 
this equation are shown in Figure 5.18. Since u = 1/r, then u must 
be positive. This means that the dashed portion of the ellipse on the 
left is not possible physically. To determine whether the ellipse has only 
positive values, we can use the u intercepts. Setting v = 0 in (5.47) yields 
Ut = Us +co/p. As shown in Exercise 7, to have u_ > 0 it is required 
that k > mr(0)?[6’(0)|?. Therefore, as long as the initial angular velocity 
6’(0) is not too large, the particle will orbit the particle at the origin. 

To demonstrate what a solution curve looks like, the numerical solu- 
tion of the central force problem in (5.42) is shown in Figure 5.19. The 
orbital path in the r,v-plane is on the left. The physical path, in the 
x,y-plane, is shown on the right. 

The question arises as what happens when you get an ellipse like the 
one on the left in Figure 5.18. Irrespective of which point you start at 
on the solid curve, and no matter which direction you go on the curve, u 
approaches zero. In other words, r + oo. Physically, what is happening 
is that the angular momentum is so large that an orbit is not possible, 
and the particle simply escapes whatever hold the particle at the origin 
might have on it. It is also evident from Figure 5.18, contrary to what 
is often shown in cartoons, that the particle does not make several orbits 
around the origin before escaping. In fact, the particle is incapable of 
making even one complete orbit. 


Exercises 


1. Suppose the law of gravity results in f(r) = —k/r°, where k > 0. You 
can assume that k 4 mp?. 


a) Are there any steady state solutions? If so, check on their stability. 


1.5 0.7 
a a 
% % 
_¢ © S 0 
> > 

-1.5 1 ! -0.6 1 1 4 
0 1 2 0 1 2 
r-axis x-axis 


Figure 5.19. Numerical solution of (5.42) in the case of when the solution is 
periodic. The initial position, and direction of motion, are shown on each curve. The 
two time points used to place the direction arrows on the left are the same time points 
used on the right. 
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b) Assuming there is a periodic solution, determine its equation in the 
u,v-plane. 

c) Use your result from part (b) to explain why there is no periodic 
solution of this problem. 


. Suppose the law of gravity results in f(r) = —kr, where k > 0. Note 


that this is assuming that gravity acts like an elastic spring. 


a) Are there any steady state solutions? If so, check on their stability. 

b) Assuming there is a periodic solution, determine its equation in the 
r,v-plane. 

c) The solution curve is shown in Figure 5.20 in the case of when 
r(0) = ro and v(0) = 0. Show that the second r intercept is at 
ro(rs/To)”, where rs is the steady state you found in part (a). 

d) Where is the steady state located in Figure 5.20? 


. This problem concerns the solution shown in Figure 5.19. 


a) In Figure 5.19(left), where is r, located? 
b) In Figure 5.19(right), sketch in the circular orbit derived in Section 
5.4.1. 


. What initial conditions correspond to someone throwing a baseball so 


that it encircles the Earth at a constant height, and then returns to 
the person who threw it? Some of the results from Exercise 7 might 
be useful here. Assume the Earth is a smooth sphere with radius R. 


. This exercise explores the usefulness of making the change of variables 


from r, t to u, T, where u(7) = 1/r and 7 = O(t). This is an approach 
often used in physics textbooks. 

a) Show that r’(t) = —pu’(r), and r’(t) = —p?u?u!(r). 

b) The mathematical requirement for the change of variables to be 


valid is that 0(t) is a strictly monotonic function of t. Explain why 
this holds in this problem. 


c) Using the results from part (a), show that (5.42) takes the form 


v-axis 
o 


r-axis 


Figure 5.20. Solution curve for the problem in Exercise 2. 
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d) Assuming that f(r) = —k/r?, find the general solution of the result- 
ing differential equation in part (c). In doing this, use (3.22) when 
writing down the general solution of the associated homogeneous 
equation. Also, what is the resulting formula for r? 

e) Use the results from Exercise 7 to show that u(0) = 1/a 9 and 
u'(0) = —2x$/(xoyg). Use these to find the two arbitrary constants 
in your solution in (d). 


. Let p = x x x’. In this exercise you will likely need to review the 


properties of the cross product you learned in calculus. 


a) Show that p’ = 0. This means that p is a constant vector, and 
so, from the initial conditions, p = x9 X vo. It is assumed that 
Xo X Vo fx 0. 

b) Explain why p- x = 0 and p- x’ = 0. Why does this mean that 
x and x’ are in the plane that is perpendicular to p, and which 
contains the origin? 

c) Assuming x = (r(t) cos@(t),r(t) sin @(t),0), show that p = r76’k, 
where k is the unit vector pointing in the positive z-direction. 

d) The plane has normal p as well as normal —p. Which one is used 
when orientating the positive z-axis in such a way that r26/ > 0? 


. This problem determines how the initial conditions for (5.38) con- 


tribute to the reduced problem for the orbit. Assume that xg = 
(xo,0,0)7 and vo = (x), 6,0)", where xo, xg, and yg are given with 
xo and yj both positive. The superscript T indicates transpose. Also, 
assume that f(r) = —k/r? and 6(0) = 0. 

a) Show that p = xoyp. 

b) Show that the initial conditions for (5.42) are r(0) = xo, r’(0) = x6. 
c) Show that u— > 0 reduces to the requirement that k > mao(yp)?. 


Chapter 6 


Laplace Transform 


We have found that to solve y” + by! +cy = 0 you assume that y = e”*, 
and for x’ = Ax you assume that x = ae”. What is notable here is the 
exponential dependence of the solution on t. It is possible to extend this 
assumption in such a way that it is possible to solve a wide variety of 
more complicated problems, such as those involving partial differential 
equations. This chapter concerns one such extension. 


6.1 =» Definition 


The generalization we are interested in called the Laplace transform, and 
its definition is given next. 


Laplace Transform. Given a function y(t), for 0 <t < ov, its Laplace 
transform Y(s) is defined as 


Y(s)= - y(t)e “dt. (6.1) 


It will be useful to have a more compact notation for the integral in this 
expression, and this will be done by writing the above formula as 


Y(s) = L(y). (6.2) 


The Laplace variable s is analogous to the r used in the assumption y = e” 


or x = ae”. Consequently, it should not be a surprise to find out that 
the variable s is, in general, complex-valued. 
Improper integrals similar to the one appearing in (6.1) are covered in 


the Techniques of Integration chapter in your standard calculus textbook. 


Introduction to Differential Equations, M. H. Holmes, 2023 
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As you should recall, they are defined using a limit, which in this case is 


rE 
Y(s) = lim y(t)e “dt. 
To Jo 

There is a slight complication here because s is complex-valued. For this 
reason, use of the limit is postponed until Sections 6.5 and 6.6. Instead, 
the first part of this chapter concentrates on the operational use of Laplace 
transforms, with the goal of solving differential equations. After that, 
applications to distributions and linear systems are considered. 

The key tool in what follows is Table 6.1 (on page 158). For the 
functions y(t) listed in the third column of that table, their corresponding 
Laplace transform Y(s) is given in the second column. 


Example 1: If y(t) = sin 2t, find Y(s). 


Answer: Noting that y(t) is given in Property 10 of the table, with 
a =0 and w = 2, then its Laplace transform is 


2 
Y(s) = ——_.. 
(s) s2+4 
This can also be written as 
2 
L(sin2t) = ~—_.. EH : 
(sin 2t) AoGA (6.3) 


6.1.1 » Linearity Property 


Because of the way it’s defined, the Laplace transform inherits the basic 
properties of integration. Of particular importance is linearity. Namely, 
if c, and co are constants, then 


L(crys + cay2) = aL(yr) + c2£(ye). (6.4) 
Another way to write this is, if y(t) = c:y1(t) + caye(t), then 
Y(s) = c1Y1(s) + c2Yo(s), (6.5) 


where Y; and Y> are the Laplace transforms for y; and yo, respectively. 
Because the Laplace transform has this property, it is said to be a linear 
operator. The usefulness of the linearity of the Laplace transform is why 
it is listed as Property 1 in Table 6.1. 
Example 2: If y(t) = 3t — 2e~", find Y(s). 

Answer: According to (6.4), 


L(3t — 2e~") = 3£(t) — 2£(e*). 
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From Property 9, with n = 1 and a = 0, we have that Lg ) = 
1/s?. Similarly, from Property 8, with a = 4, L(e~") = 1/(s + 4)?. 
Therefore, 


Voss ae " (6.6) 


It is possible to extend the usefulness of Table 6.1 by using some of the 
properties of a Laplace transform. Exercise 2 considers one of particular 
note. 


Exercises 


1. Find the Laplace transform of the following functions. 
a) y= —e™ e) y= 4t? i) y=5 + 2e* sin(4t) 
b) y=3+4+4¢ f) y=(t-—3) j) y = 3e' + 4cos(2t) 
c) y=2t+7e! g) y=4(t+1)? k) y = cos(t) sin(2t) 
d) y=e-% —4te™ hh) y = —10cos(8t) 1) y=sin?(5t) 


2. If n is a positive integer, then L(t"y) = (-1)" L(y). So, 


c(v)=—4c(y), and ely) =e). 6.7) 


For example, since £(cost) = z57 , then L(t cost) = —4 (s/(s?+1)) = 
(s? — 1)/(s? + 1)?. In a similar manner, find the Laplace transform of 
the following functions: 


a) tsin(3t) b) 6¢ cos(7t) c) t? cos(t) d) te~?¢ sin(5t) 


3. Assuming that a1, a2, ---, Gp are given numbers, determine the Laplace 
transform of the following: 


a) Ss axt* b) S- ane ** c) Ss" ax sin(krt) 
k=0 k=0 k=1 


6.2 » Inverse Laplace Transform 


As will be seen when we get around to solving differential equations, we 
will use the Laplace transform to change the problem from solving for y 
to solving for Y. It is actually fairly easy to do this. Once Y is known, 
it is then necessary to determine y. This requires us to know how to find 
the inverse Laplace transform, and this will be done using Table 6.1. 
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Y(s) = L(y) y(t) =L£°1(Y) 
1 (s) + bV(s) (t) + bv(t) 
2. | W(s)Y(s) if w(t — r)y(r)dr 
3. | sY(s) y(t) + y(0) 
4 Ly(s) i y(r)dr 
Beer ¥ (Ss) y(t—a)H(t—a) fora>0 
6. | Y(s+a) e~ y(t) 
2 few H(t—a) fora>0 
8. ss et 
9. at te Tora 
10. aye e % sin(wt) 
11. SWAT EPR e * cos(wt) 
le + (ac+ dt| e* if 1 =]s.=—4 
1, Ena al (ae + dje* — (be + djeh if a = b 
e*|ccos( cos(bt) + 244 sin(t)| if = - aol 7 
||! eo" d(t—a) fora>0 
14. GHP eee c=, (t—a)"le*-®) H(t—a) for ae a 
13; + e-*Y(s) A(t— af" y(r)dr fora>0 


Table 6.1. Laplace and inverse Laplace transforms. The function H(x) is 
defined in (6.25), and 6(t) is defined in Section 6.7.1. 
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Using the £(y) notation, the inverse Laplace transform is written as 
L-'(Y). For example, from (6.3), 


2 


L(sin 2t) = Pad? 


so the inverse transform is 


Similarly, from (6.6), 


3 2 
1 —At 
L (3 ot (s+4)? 2) = 3t — 2e : 


The above formula is an illustration that the linearity property applies to 
the inverse transform. The formula is 


Lay + c2Y2) — L(Y) + col *(Y9). 
This is used for many, if not most, of the examples in this chapter. 


3 


Example 1: If Y(s) =3 — ate. find y(t). 


Answer: Using the linearity property, 


£-\y) = aa 3 7s ) 


gs? g2 +95 


=s0-1(5) —10°"(* 9) 


From Property 9 in Table 6.1, with n = 1 and a = 0, 


cg)=0 


Similarly, from Property 11, with a = 0, and w = 5, 


=F s ) = t 
(= 55 cos(5t). 


Therefore, 
y(t) = £L71(Y) = 3t —7cos(5t). ff 


Example 2: Find the inverse transform of 


2 
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Answer: To use a direct approach, we will break Y(s) down into 
simpler components by using partial fractions. This is done as fol- 
lows: 
2 Ag+ B . Cs+D 
(s?+1)(s?+4)  s2+1 - st+4 
(A+C)s? + (B+ D)s? + (44+C)s+4B+D 
(s2 + 1)(s? + 4) ; 


Equating like powers of s in the numerators, we get that A+ C = 0, 
B+D=0,44+C=0, and 4B + D = 2. Solving these equations 
one finds that A = 0, B = 2/3, C = 0, and D = —2/3. So, using 
Table 6.1, 


es + ne =) = sf 1(s—5) s£\(=-3) 


1 
= —sint — =sin2t. 
3 


wl bb 


There is another way to derive this result, that does not use partial 
fractions, and this is shown in Section 6.3. =I 


Exercises 


1. Find the inverse Laplace transform of the following functions. 


15s 


a) Y =255 h) ¥ =()(s?=16) 

bya ane = i) Y =o 20 

o) Y=ay3c )¥ =e + wap + 
d) Y=, k) ¥ =25 

0) Y= 35] )Y=sH-2 

f) Y ="ipeno mY =e 

2) Y = GHD) NY =3i3 


2. Find the inverse Laplace transform of the following functions using 
Property 4 of Table 6.1. 


a) Y =a) hb. ve c) Y= 
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6.3 = Properties of the Laplace Transform 


What follows is the derivation of Properties 2 and 3 in Table 6.1. They 
are important as they will be needed when solving differential equations. 


6.3.1 » Transformation of Derivatives 


One of the hallmarks of the Laplace transform, as with most integral 
transforms, is that it converts differentiation into multiplication. To ex- 


plain what this means, using integration by parts (with u = e~* and 
dv = y'(t)dt), we have the following: 
cy) = [year 
0 
= yes oe 4 »| ye **dt 
t=0 0 
= sL(y) — y(0). (6.8) 


It has been assumed that limy.. y(t)e~** = 0 (this limit is discussed 
in more depth in Section 6.6). It has also been assumed that y/(t) is 
piecewise continuous, and y(t) is continuous, for t > 0. 

The above formula can be used to find the transform of higher deriva- 
tives. As an example, for the second derivative, since y” = (y’)', we have 
that 


L(y") = sL(y’) — y'(0) 
= s[sL(y) — y(0)] — ¥(0) 
= s’L(y) — y!(0) — sy(0). (6.9) 


The new requirements here are that lim; 5. y’(t)e~* = 0, y'(t) is piece- 
wise continuous, and y(t) is continuous, for t > 0. 

There are similar formulas for the Laplace transform of the higher 
derivatives, but they are not needed in this text. 


Example 1: Find the Laplace transform of y’ + 3y, where y(0) = 2. 


Answer: Using the linearity of the transform, and the derivative 
formula (6.8), 


L(y! + 3y) = L(y’) + 3L(y) 
sL(y) — y(0) + 3L(y) 
(s+3)Y(s)-2. & 
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6.3.2 »« Convolution Theorem 


A common integral that arises when solving differential equations is a 
convolution integral of the form 


iar / eG (6.10) 


Taking the Laplace transform of this equation we obtain 
lee) t 
Lg) = | | w(t —7)f(r)e “drt 
0 JO 
-| i. w(t — 7) f(r)e7 dtdr. 
0 T 


In the last line above, interchanging the order of integration used the fact 
that 0O<t<oo,0<7 < tis equivalent to0 <7T<aw,T<t< oo. Now, 
making the change of variables t = r+7 in the inner integral, we get that 


ety) = fo fo wintry dra 


= / (serye* / * u(r ear) dr 


= W(s)F(s). 


Using the inverse transform this can be written as 


£-(W(s)F(s)) = i ea Dae: (6.11) 
0 


where w(t) = L~'(W) and f(t) = £-!(F). This is Property 2, in Table 
6.1, and it is known as the convolution theorem. 


Example 2: Use the convolution theorem to find the inverse transform 


of 
2 


(s? + 1)(s? +4) ° 
Answer: Taking W(s) = 2/(s? +1) and F(s) = 1/(s? +4), then 
w(t) = 2sint and f(t) = 5 sin(2t). So, from (6.11) and the identity 
2 sin ™ sin ¢ = cos(0 — ¢) — cos(A + ¢), 


_ 2 ee 
Ls Le Des zB) = / sin(t — 7) sin(27)dr 
; / (cos(t — 37) — cos(t + T)) dr 
2 


1 
3 sin(t) — 3 sin(2t). 
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Exercises 


1. Find the Laplace transform in terms of Y(s). 


L(y! — 4y), where y(0) =1 
: ee + Ty), where y(0) = —2 
c) Lily" + by), where y(0) = 1 and y/(0) = —-1 
d) L(y” + 3y/ — 2y), where y(0) = 1 and y/(0) = —3 
e) L(4y” + 2y’), where y(0) = —1 and y/(0) =1 
2. Use the convolution theorem, as given in (6.11), to find the inverse 

transform. 

1 : 1 1 
a) CHE , taking W(s) =a and F'(s) =e 
b) (Hz , taking W(s) =i and Fs) = 244 

— fee 

¢) GHj(s=4) e) S241) 

1 i 
d) Gap w= 1) S40) 


6.4 = Solving Differential Equations 


The examples to follow illustrate how to use the Laplace transform to 
solve a linear initial value problem. As you will see, it is fairly easy to 
transform the equation and then solve for Y(s). Most of the work is done 
trying to determine the inverse transform to find y(t). 


Example 1: Solve y’ + 3y = e”!, where y(0) = 2. 
Answer: The first step is to take the Laplace transform of the dif- 
ferential equation, which gives 


L(y! + 3y) = L(e*). 


Using the linearity of the transform, and the derivative formula 
(6.8), 


L(y’ + 3y) = L(y’) + 8L(y) 
= sL(y) — y(0) + 3L(y) (6.12) 
= (s+3)Y(s) —2. 


Also, using Property 8 from Table 6.1, 


1 


L(e*) = a9 . 
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The transformed problem is therefore (s + 3)Y — 2 = 1/(s— 2), and 
from this we get that 


1 1 
¥=——(2+—,). 
s+3 s—2 
Consequently, using Table 6.1 (Properties 8 and 12), 


3) (yer) 


1 
— 9e-3t 4 = (prt _ p-3t 
€ ae x (e € ) 
9 1 
= ee + se i 


Example 2: Solve y” + y/ — 2y = —sint, where y(0) = 1 and y/(0) = 1. 


Answer: Taking the Laplace transform of the differential equation 
L(y” +y! — 2y) = L(-sint). 


Using the linearity of the transform, and the derivative formulas 
(6.8) and (6.9), 


L(y" + y' — 2y) = L(y") + L(y’) — 2L(y) 
= s°Y — y/(0) — sy(0) + sY —y(0)—2Y (6.13) 
= (s?+s—2)Y —s—2. 


Since, using Property 10 in Table 6.1, £(sint) = 1/(s? + 1), then 
the transformed problem is 


1 
Di = 
(s°+s—2)¥Y —s—2 aca 
Solving for Y gives us 
1 1 
Y= : (6.14) 


s—1  (s?+1)(s?+s-—-2) 


Taking the inverse transform, and using linearity, 


y= £1) (sayrascy): 


Using Table 6.1, Property 8, 
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For the other inverse transform, we will use partial fractions. The 
assumption is that 


1 Ast BB, Ca+D 
(s?+1)\(s?+s—2) s24+1 ° s2?+5-2 
(A+ C)s? + (A+B4+D)s? +(-2A+B+C)s—2B+D 

(s? + 1)(s? + s — 2) 

Equating like powers of s in the numerators, we get that A+ C = 0, 
A+B+D=0, -2A+B+C =0, and -2B+ D =1. Solving 
these equations one finds that A = —1/10, B = —3/10, C = 1/10, 
and D = —2/5. So, using Table 6.1, Properties 10 (for A), 9 (for 
B), and 11 (for C and D), 


E+(T5 + De +s5— 5) = cs 7 *) +e1( +") 


1 
= Acost + Bsint + 5 l(c + Dye + 20 — D)e~™ (6.15) 


Therefore, the solution is 


Ustad obs eet 2 z 
= Cc } int 4 { . 
a gee aps ine 6. 


Three comments need to be made about the above examples. First, 
both can be solved much easier using the method of undetermined coef- 
ficients. The Laplace transform was used to illustrate how it can be used 
to solve such problems. Second, the question invariability comes up as to 
what is the easiest way to determine the inverse transform. For example, 
you can use the convolution theorem or partial fractions to obtain (6.15). 
There is often no clear answer to which one to use, and it often depends 
on what you are the most comfortable with and what is applicable. As it 
turns out, except perhaps when taking a course in differential equations, 
very few people work out even slightly complicated inverse transforms by 
hand. Instead, they either buy a book of tables, such as Oberhettinger 
and Badii [1973], or, even more likely, they use a symbolic computing 
system like Maple or Mathematica. 

The third comment has to do with whether the solution of the IVP 
satisfies the conditions required to take the Laplace transform (the con- 
ditions are discussed in Section 6.6). If there is any concern about this, it 
is always possible to simply check that the derived solution satisfies the 
IVP. 


6.4.1 » The Transfer Function 


In engineering, when solving a linear differential equation, it is common to 
introduce what is known as the transfer function W(s). To explain what 
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this is, for the mixing, vertical motion, and cooling problems in Section 
2.3, the resulting differential equation can be written as 


y' + ay = f(t), (6.16) 


where f(t) is an external input function. Similarly, the oscillator problems 
in Section 3.10 produce equations of the form 


my" + cy’ + ky = f(), (6.17) 


where f(t) is an external forcing function. If you take the Laplace trans- 
form of (6.16) or (6.17), and assume homogeneous initial conditions, you 
end up with an expression of the form 


Y(s) = W(s)F(s), (6.18) 


where F'(s) = L(f). In this sense, W(s) is the transfer function from the 
input F(s) to the output Y(s). 


Example 3: Find the transfer function for y’ + 3y = f(t). 


Answer: Because the transfer function requires a homogeneous ini- 
tial condition, we take y(0) = 0. With this, after taking the Laplace 
transform of the differential equation, we get (s+ 3)Y = F. This 
means that Y = sak , and so the transfer function is W(s) = 
1/(s+3). 


Example 4: Find the transfer function for y” + y! — 2y = In(1 + t?). 


Answer: The required homogeneous initial conditions are y(0) = 0 
and y'(0) = 0. With this, after taking the Laplace transform of the 
differential equation, we get (s?+.s—2)Y = F, where F = £(In(1+ 
t?)). Consequently, the transfer function is W(s) = 1/(s? + s — 2). 
i 


Once you know the transfer function, then a particular solution of the 
differential equation can be written down using the convolution theorem. 
Namely, using (6.11) a particular solution of (6.16), or of (6.17), is 


LS / wean mdE (6.19) 


where w(t) = £~1(W). It is important to note that y,(t) satisfies the 
initial conditions used to determine W(s). So, for Example 3, yp)(0) = 0, 
while for Example 4, y)(0) = 0 and y/,(0) = 0. 
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Solving an IVP 


The above solution is useful as it can be used to solve the IVP when 
the initial conditions are not zero. This is because the solution can be 
written as y(t) = yp(t) + yn(t), where y,(t) is given in (6.19) and yp(t) 
is the solution of the associated homogeneous differential equation that 
satisfies the initial conditions. This is similar to the approach used in 
Section 3.9.1. Moreover, it is not necessary to use the Laplace transform 
to find y,(t). An example of solving an IVP in this way is given next. 


Example 5: Solve y” — 2y’ — 3y = Vt, where y(0) = 1 and y'/(0) = —1. 


Step 1: Find W(s). To find the transfer function for y/’ —2y/—3y = 
f(t), the homogeneous initial conditions to use are y(0) = 0 and 
y' (0) = 0. Taking the Laplace transform of the differential equation 
one finds that W(s) = 1/(s? — 2s — 8). 


Step 2: Find y,. Using Property 12 from Table 6.1, w(t) = 
L-1(W) = (e** — e~*)/4. So, from (6.19), 


t 
Up(t) = if [er = ern | Jrtdr. 


0 


The integral can not be written in terms of elementary functions, 
and so the answer is left in integral form. Also, based on the com- 
ment following (6.19), in this problem yp(0) = 0 and y;,(0) = 0. The 
significance of this is that we are going to write the solution of the 
IVP as y(t) = yp(t) + yn(t). So, y(O) = yp(0) + yn (0) = yn (0) and 
y'(0) = y,(0) + y,(0) = y,(0). This means to satisfy y(0) = 1 we 
require y;,(0) = 1, and similarly we require yj,(0) = —1. 


Step 3: Find y,. The IVP to solve is y” — 2y/ — 3y = 0, where 
y(0) = 1 and y/(0) = —1. Assuming that y = e™, and proceeding 
as in Section 3.5, one ends up finding that y,(t) =e. 


Step 4: The solution is y = yp + yp. In other words, 


1 


t 
y(t) =e *+ if lee —e | /rdr. & 
0 


6.4.2 » Comments and Limitations on Using the Laplace Transform 


It is useful to know some of the limitations on using the Laplace transform 
to solve a differential equation. First, the differential equation must be 
linear. As the examples illustrate, the Laplace transform can be used 
irrespective of the order of the equation. It can also be used to solve partial 
differential equations, delay equations, and integral equations. However, 
in all cases, the equations are linear. 
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A second limitation is that the differential equation should have con- 
stant coefficients. For example, the Laplace transform will not be suc- 
cessful when trying to solve y’ + e'y = 0 or y” + (14+ t)?y’ + 5y = 0. 
Occasionally you will come across an equation with non-constant coeffi- 
cients that can be solved using a Laplace transform, and an example is 
Airy’s equation y" +ty = 0. You might try finding the Laplace transform 
of this equation to see why the coefficients are “just right” so that the 
method works. 


Exercises 
1. Use the Laplace transform to find the solution of the IVP. 
a) 2y'+y=1, y(0)=2 
b) 3y =-y+e*, y(0)=35 
c) y +y'—2y=0, y(0) =0, (0) =-1 
d) y” — 6y' + 9y=0, y(0) =0, y'(0) =2 
e) Sy” —y'=0, y(0)=—1, y'(0)=—-1 
f) 4y° y= 0, gO) = =1,. 9 (0) = a1 
g) y — 2y'+2y=0, y(0)=—-1, y/(0)=-1 
) y" + 2y + Sy =0, y(0) =0, y'(0) = -6 
2. Use the Laplace transform to find the solution of the IVP. 
a) y +y! — 2y = 124, y(0) = 0, y'(0) =0 
b) y" + 4y = 827, y(0) =0, y/(0) =0 
c) y’—-y' = 2sint, y(0) =0, y/(0) =0 
d) y” + 3y = 3t+ 1, y(0) = 0, y/(0) = 0 
e) y” — 2y' + By =5 —4e*, (0) = 0, y/(0) =0 
3. For the following, find the transfer function W(s) and then write down 
the resulting particular solution. You do not need to evaluate the 
integral. 
a) y’ + 3y = In(1 + 3¢) 
b) y+ 9y = V1 +t 
c) 2y" + By’ —2y = 1/0. +2) 
d) y” + 2y! + 5y = sin(1 + #?) 


4. Proceeding as in Example 5, find the solution of the following IVPs. 


a) y’ +3y =In(1 + 3t), where (0) = 1 

b) y” +9y = V1 +t, where y(0) = 1 and y'(0) =0 

c) 2y" + 3y' — 2y = 1/(1 +t), where y(0) = 2 and y/(0) = -3 
d) y" + 2y/ + 5y = sin(1 + 17), where y(0) = 0 and y/(0) = 2 
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6.5 » Jump Discontinuities 


It is not unusual to have functions with jump discontinuities. What a 
jump discontinuity means is that y(t) is not continuous at the point, 
but the limits of y(t) from the left and right are defined and finite (the 
two limits do not need to be equal). A simple example, with a jump 
discontinuity at t = 2, is 


a AF Oa 2: 


y(t) = ule (6.20) 


—1 if 2<t. 


It is informative to determine the Laplace transform of this function using 
the definition. The steps involved are: 


v(@)< i * y(ten**at 


= -. 6.21 
ae + ( ) 


The last step requires the assumption that Re(s) > 0. 

One might expect that the inverse transform of (6.21) is (6.20). This 
is true everywhere but at the point of discontinuity. At a point t = a 
where the original function y(t) has a jump discontinuity, £~!(Y) equals 
the average in the jump in y(t) at that point. The formula is, for a > 0, 


£1) = 5[vet)+u(o-)]. (6.22) 


0), at t = 2 the average in the jump is equal to 


Te illustrate, for (6.20 
= 5(3 —1)=1. Therefore, the inverse transform is 


5[y(2*) + y(27)] 
a Se he 
LAY) Ss i, -a- =, (6.23) 
—1 if 2<t. 
This can be written in a more compact form as 
£7(Y) =3-—4H(t — 2), (6.24) 
where H(z) is the Heaviside step function and is defined as 
0 if «<0, 
a eae, (6.25) 
1 a On ep 


H(2)= 
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Figure 6.1. Heaviside step function H(«) as defined in (6.25). 


The function H(z) is shown in Figure 6.1. Note that this has built into 
its definition the value at a jump that is needed for the inverse Laplace 
transform. 

As the above example illustrates, if you only know the Laplace trans- 
form of y(t), it is not possible to determine its value at the jump. For 
example, in (6.20) if you change y(t) so y(2) = 0, or y(2) = 10, the Laplace 
transform is still given in (6.21). The function in (6.23) is the answer that 
comes from the formula for the inverse Laplace transform given in (6.30). 
This situation will arise in this chapter any time the function y(t) has a 
jump discontinuity. 


Example: If Y =2 + 2e-8s_ Gems, find and then sketch y. 


Ss 


Answer: Using the linearity property, 


2 5 6 
-lry) = i M5738 4s 
ee ae) 


1 1 1 
=20-1(2) +5c-1(e) —6c-1(Le-s). 
8 8 8 

From Property 8 in Table 6.1, with a = 0, 

1 

e7(-) =. 

8 

From Property 7, with a = 3 and a= 4, 


£1(-<%) = H(t—3), and £7! (<e*) = H(t —4). 


Therefore, 


y(t) =2+5H(t — 3) —6H(t — 4). (6.26) 
So, the solution starts out at y = 2, it has a jump of 5 at t = 3, so 
y = 7, and then it has another jump of —6 at t= 4, so y=1. At 
the jumps, y(3) = $(2+7) = 3, and y(4) = $(7+1) =4. The plot 
of this function is given in Figure 6.2. 
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Figure 6.2. The function y(t) given in (6.26). 
Exercises 


1. 


Sketch the function for 0 < t, and then find its Laplace transform. 
a) y= H(t-6) d) y=3-2H(t-1) 

b) y= A(t — 1) — H(t -3) e) y=t—(t—1)H(t-1) 

c) y = 38H(t — 2) —4H(t— 5) f) y =sin(t — 3)H(¢— 3) 

g) y= 1-2-1) 4+ 280¢—2)— 20-3) 

h) y=t—2(t-—1)H(t —1) + 2(t — 3) A(t — 3) — (t-—4) A(t — 4) 


. Find the inverse Laplace transform of the following functions. 


oe By. A 7 
a) Y =(s+1)2+9° ‘ d) ¥ = ga Ir ae sf 
io) =(4 = 5 )e e) Y= a yt 


. Suppose that y(t) is periodic with period T > 0. So, y(t+T) = y(t) 


for all t > 0. 
a) Show that 


[- ye dt = e = ¥(s). 


T 


b) Writing [5° y(t)e “dt = Jo yer "dt + fr y(t)e “dt, use the re- 
sult from part (a) to show that 


vie yet (the “dt 
a nT Ts oo , 


. The following functions are periodic with period T. Sketch the function 


for 0 < ¢t < 37, and then use the result of Exercise 3(b) to find the 
Laplace transform. Also, provide an explanation for where the name 
of the wave comes from. 


a) Square wave: T = 2, and y(t) = H(t) — H(t —1), forO<t <2. 
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b) Sawtooth wave: T = 1, and y(t) =t, forO<t< 1. 

c) Triangle wave: T = 2, and y(t) = tH(t) — 2(¢ — 1) H(t — 1), for 
O0<t<2. 

d) Bang-bang wave: T = 2, and y(t) = H(t)—2H(t—1), forO<t <2. 

5. The floor function y(t) = |t| is the greatest integer less than or equal 
to t.-50;.1.5.9| = 5.and:||'7:0| = 7. 

a) Writing |t| =t— g(t), what are: g(0), g(0.1), g(0.8), and g(1)? 
b) Sketch g(t) for 0 < t < 5. Use this to explain why g(t) is periodic. 
c) Use the result from Exercise 3(b) to find £(|t]). 

6. It is sometimes useful to use a power series to determine an inverse 
transform. For example, the geometric series is (1—z)~! = 1+ z+2?+ 
234-.., Taking z = e—*, you get (l—e~*)—! = 1+e-S$+e7*% +e 38 +---, 
In this problem you are to use a Maclaurin series to find the inverse 
Laplace transform. 


a) Y = eae use the geometric series for (1 — z)~!. Also, sketch 
y(t) for0<<t<4. 
b) Y = Site) , use the geometric series for (1 — z)~!. Also, sketch 
y(t) forO<t<8. 
a ae : -1/2 
c) z ~avipe , use the series for (1 + z) . Also, sketch y(t) for 
<t<A4. 


d) =1,/1+(1/s), use the series for V1 + z. 


6.6 » Mathematical Foundations 


Much of the material in this section concerns the mathematical require- 
ments needed to carry out the integration in (6.1). 

For the improper integral in (6.1) to exist, a condition must be im- 
posed on the complex variable s. To explain, if y(t) = e*”, then using the 
definition of an improper integral and (6.1) 


T ac 
Y(s) = lim ee dt = lim eB) at 
T- 00 0 T-0o (0) 
1 
rag (3-s)T _ 
jim [ge sa] ee 


Clearly, we need s # 3. As for the limit, it is useful to know that, given 
a nonzero complex number z, 


os, ee 0 if Re(z) < 0, 
lim e** = ‘ : 
T00 does not exist if Re(z) > 0. 


(6.28) 
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The proof of this comes directly from Euler’s formula, as expressed in 
(3.14). For (6.27), z = 3-—s and this means that for the limit to exist we 
need Re(3 — s) < 0, or equivalently, we need Re(s) > 3. In this case, 


The requirement that Re(s) > 3 gives rise to what is known as the half- 
plane of convergence for the Laplace transform. 


Example: If y(t) = sin 2t, find Y(s). 


st 


Answer: Using (6.1), and integration by parts (with u = e~* and 


dv = sin 2t dt), 


¥is).= i: sin(2t)e “dt 


I 
| 
| 
lo) 
ie) 
n 
— 
iw) 
nd 
wma 
si 
H 
<e 


Ss (oe) 
— = | cos(2t)e~ “dt 
2 Jo 


t=0 
s (oe) 
a a cos(2t)e~ “dt. 


To guarantee that cos(2t)e~* has a finite limit as t + oo, it has 
been assumed that Re(s) > 0. Using integration by parts again, 
you find that 


Solving for Y, we get that Y = 2/(s? +4). Using the L(y) notation, 


we have that 9 


s2+4- 
The half plane of convergence in this case is Re(s) > 0. lf 


L(sin2t) = 


The second mathematical requirement concerns the smoothness of 
y(t). For the problems considered in this textbook, it is enough to as- 
sume that y(t) is continuous for 0 < t < co, except possibly for a few 
jump discontinuities. To state that y(t) has a jump discontinuity at t = a 
means that y(t) is not continuous at the point, but the limits of y(t) from 
the left, y(a~), and from the right, y(a*), are defined and finite. This 
is the requirement when a > 0. To have a jump discontinuity at t = 0 
means y(0*) is defined and finite, but it is not equal to y(0). What we 
will assume is that over any interval 0 < ¢t < T, y(t) is continuous except 
for possibly a finite number of jump discontinuities. In this case, y(t) is 
said to be piecewise continuous for t > 0. Several examples of piecewise 
continuous functions can be found in Section 6.5. 
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The final requirement on y(t) is to guarantee that the improper inte- 
gral in (6.1) converges. This will happen if there is a real number a so 
that 

: ot __ 
Jim y(tj)e =0. (6.29) 
If this holds, then y(t) is said to have exponential order. As examples, any 
polynomial function in t, any linear combination of sin(wt) and cos(wt), 
and any linear combination of terms of the form e“ have exponential 
order. On the other hand, e’ and e” do not have exponential order. 

It is not hard to prove the following theorem for the convergence of 
the improper integral using what is called the limit comparison test in 
calculus. 


Laplace Transform Convergence Theorem. Assume that y(t) is piece- 
wise continuous for 0 <t < oo, and (6.29) holds. With this, the Laplace 
transform L(y) exists for Re(s) > a and it converges absolutely. 


It should be pointed out that there are functions that are not piecewise 
continuous but have a Laplace transform, and an example is given in 
Exercise 3. 

Given that the mathematical underpinnings of the Laplace transform 
are being discussed, it is worth stating the formula for the inverse trans- 
form. It is in the form of a line integral in the complex plane, and it 
is 


CY \s— | “— Y(s)e*ds, (6.30) 


where the endpoints of the integral are associated with the contour shown 
in Figure 6.3. To find an inverse transform that is not determinable from a 
table, one generally is faced with evaluating this integral. Needless to say, 
these can be interesting, and often challenging, mathematical problems. 
The integral in (6.30) is where the jump formula (6.22) comes from. 
It also leads to the statement that tae 6) ee = 3y(0*). This is not 


Figure 6.3. The straight line contour, shown in red, used in the line integral 
(6.30). The half plane of convergence for Y(s) is assumed to be Re(s) > a. 
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the value used when solving differential equations. The reason is that the 
solution must be continuous at t = 0, and so we want the inverse transform 
that satisfies LY) 125 = y(0*). Using this value is permitted because 
the value of a function at a single point does not affect the value of its 
integral. 

Many of the formulas for the inverse transform have been stated with- 
out proof. If you are interested in learning about the more theoretical 
aspects of the subject, you might want to consult Davies [2002] or Schiff 
[1999]. 


Exercises 


1. By carrying out the integration in (6.1), find the Laplace transform 
and its half plane of convergence of the following functions: 
a) y=—e™ c) y = 3cos(4t) 
b) y = 4¢? dy gSte * 


2. Sketch the function for 0 < t, then find its Laplace transform and its 
half plane of convergence. 


a) y= (t-1)H(t-1) d) y = [H(t — 2)? 
by= Mt if 0<t<1 _fsint if 0<t<4n 
Y=) 9 if l<t ee = if 40 <t 


c) y=t(H(t-1)—-H¢-3)) f) y=4H(3-2) 


3. a) Let y(t) = t-!/? for t > 0. Explain why, no matter what (finite) 
value you assign to y(0), the resulting function is not piecewise 
continuous for 0 < t < co. Does it have exponential order? 


b) It is possible to show that a oe = $V. Use this to show 
that £(t~1/?) = ,/m/s, for Re(s 
c) Show that L(t!/2) = \/n/(2 — , for Re(s 


4. a) Prove Property 6 in Table 6.1. Specifically, show that L(e~“y) = 
Y(s+a). 
b) Show that if a > 0, then L(y(at)) = Y(s/a)/a. 
5. Assume that y(t) has exponential order and it is continuous except 


for a jump discontinuity at ¢t = a, where a > 0. Also, assume y’(t) is 
piecewise continuous. Show that 
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6.7 = Solving Equations with Non-Smooth Forcing 


The next example considers how to solve a differential equation with a 
discontinuous forcing function. This is a situation that is not uncommon 
in applications. 


Example: Solve x + 3y’ + 2y = f(t), where y(0) = 1, y/(0) = —1, and 


io = Oe ae Ope: 
 )0 if 8<t. 


Answer: Taking the Laplace transform of the differential equation, 
L(y" + 3y' + 2y) = Lf). (6.31) 
Using the linearity of the transform, and the derivative formulas 
(6.8) and (6.9), 
L(y" + 3y! + 2y) = L(y") + L(y") + 2L(y) 
= s°Y —y/(0) — sy(0) + 3(sY — y(0)) + 2Y 
(gp fags) =e '0: 


Also, £L(f) = ik 2e~ “dt = 2(1—-e~**) /s. Consequently, from (6.31), 
we have that 


2 
(s+1)(s+2)¥ =s+2+=(1-e-%), 
s 


which means that 


1 2 


So ee), (6.32) 


To determine the inverse transform, using Property 8 from Table 
6.1, £-1(1/(s +1)) =e~*. Also, from Property 12, 


Cc (Gsyeen) See: 


Consequently, using Properties 4 and 15 (respectively), 


a + 5G +1) (1 e**)) 


= ae + 5G + Ty co ee + xc +1) e*) 
_ 2 (er —e~*")dr + 2H(t — 3) [re —e~*")dr) 


See ie oh pel Af 3)( bee ee 
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The resulting solution is therefore 


y=1lt+e*—et (1 am ee ae »)) A(t 3). a 


A comment needs to be made about the mathematical correctness 
of the solution we just derived. Namely, y(t) and y/(t) are defined and 
continuous for 0 < t < co, but y(t) is not continuous at t = 3 (it is, 
however, continuous everywhere else). This throws into question whether 
the differential equation y” + 3y/ + 2y = f(t) is defined at t = 3. The 
way this needs to be interpreted is that the differential equation holds for 
0 <t <3, and then again for 3 < t < oo. The discontinuity in the forcing 
function effectively resets the problem at t = 3. One approach to dealing 
with this is to break the problem into two IVPs, one for 0 < t < 3, and 
another for 3 < t < oo. By using the Laplace transform we have been 
able to avoid having to do this. This is possible because the continuity 
requirements to use (6.9) are satisfied for this problem. 


6.7.1 = Impulse Forcing 


The idea underlying impulse forcing is that the force is fairly intense but it 
occurs over a short time interval. Writing the interval as tg—e < t < tote, 
we are considering the situation of when the forcing has the form 


0 if O<t<tg-e, 
f(t) = d(t) if to-—E<t<tote, (6.33) 
0 if tote <t. 


With this, the solution of y’ = f, where y(0) = 0, is 


0 if 0 < t < to mor 
y= fi .d(r)dr if ty-e<t<tot+e, (6.34) 
D if tote <t, 
where 
to+e 
D= d(r)dr. 
to—é 


We are assuming that the forcing interval is very short, but D is large 
enough to be meaningful. To put this in physical terms, it is as if we are 
hitting the system with a hammer. 

There is a mathematical idealization for a concentrated force that 
makes solving the problem easier than trying to use a formulation as in 
(6.33). This is done by introducing what is known as the delta function, 
which is given next. 
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Delta Function. The delta function 6(t) is defined to have the following 
properties: 


1. Given any to, 
d(t—to) =0, when tF# to. (6.35) 


2. Given any continuous function g(t), and assuming a < to < b: 


b 
/ 6(t — to)g(t)at = g(to), (6.36) 


and 


to b 
S(t —to)g(t)at = f (t—to)g(t)dt = Salto). (6.37) 


a to 


As an example of how the delta function is used, instead of using 
(6.33), the forcing is assumed to have the form f(t) = Dd(t — to). This 
means we are assuming that there is a delta forcing at to with strength D. 
With this, the differential equation becomes 


y' = Dé(t — to), (6.38) 


where y(0) = 0. It is worth pointing out here that, from (6.36), 6(t) has 
the physical dimension of 1/time. So, D has the same physical dimensions 
as y. In any case, the solution of this IVP is 


t 
y= i D6(r — to)dr. 
0 


To evaluate this, first note that if 0 < t < to, then from (6.35), y(t) = 0. 
If t = to, then from (6.37), y(to) = D/2. Lastly, when to < t, then from 
(6.36), y(t) = D. Consequently, the solution is 


0 if 0<t<to, 
SRO. A: ata, (6.39) 
D if to <t. 


Except for the very small time interval tgp —¢ < t < tg +¢, this solution is 
the same as the one in (6.34). Moreover, the above solution is consistent 
with what is obtained using (6.30). 

The rationale for the stated properties of the delta function can be 
explained by considering the case of when d is constant. The assumption is 
that the total force D, what is known as the impulse, remains fixed as the 
time interval decreases (see Figure 6.4). This requires that d = D/(2e). 
In other words, the magnitude of the force increases as the time interval 
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J 


to t 


Figure 6.4. A fixed impulse, applied over the time interval tp —e < t < tote, 
used to explain the stated properties of the delta function. 


decreases. Consequently, in the limit, the forcing is zero if t ~ to and it is 
infinite at ¢t = to. This explains (6.35), and it also explains why you will 
see the statement that 6(0) = co. This limit can also be used to explain 
(6.36). Finally, it is being assumed that the impulse forcing is symmetric 
about to, as it is in the case of when d is constant, and this gives us (6.37). 


Example 1: If f(t) = 56(t — 1) — 96(t — 2) + 6(t — 3), find L(f). 
Answer: Using linearity and Property 13 in Table 6.1, 


L(f) = 5L(d(t — 1)) — 9L(d(t — 2)) + L(4(t — 3)) 


=5e°—9e*% +e. HF 


Example 2: Solve y” + y = 26(t — 15), where y(0) = 0 and y’(0) = 0. 


Answer: Taking the Laplace transform of the differential equation 
gives L(y” +y) = £(26(t—15)). Using the linearity of the transform, 
and the derivative formula (6.9), we get that 


s*Y — sy(0) — y/(0) + Y =2e*. 
From the given initial conditions, and solving for Y, 


2 
Y= 15s — 
ee 


Since 


2 
aa >) = 2sint, 
8 


then using Property 5, from Table 6.1, 


y =2sin(t—15)H(t—15). Of 


Example 3: Evaluate ia 6(r)dr, for —-co <t < ow. 


oe) 
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Answer: This can be answered by considering three cases. First, if 
t <0, then 6(r) = 0 for —co < r < t, and we conclude the integral 
is zero. If t > 0, then from (6.36) with g(t) = 1, the integral is equal 
to one. Finally, when t = 0, from (6.37) we get the value of 1/2. 
Therefore, we have that 


H(t) = / 5(r)dr- 


In this sense we can write that 


Example 4: For the mixing problem in Example 1 on page 21, suppose 
that after 2 minutes that 5lbs of salt are dropped into the tank. 
What is the resulting IVP for Q? 


Answer: To answer this, consider the simpler situation of when 
there is no inflow or outflow, and the tank contains salt water with 
Qolbs of salt. Also, suppose that at t = tp an additional D lbs of 
salt are dropped in. It’s assumed that the salt dissolves instantly. 
In this case, the total amount of salt in the tank can be written 
as Q(t) = Qo + DH(t — to). From this it follows that Q’(t) = 
D6(t — to). Consequently, for the mixing problem, the differential 
equation (2.32) changes to 


The initial condition is unchanged. 


Mathematical Tidbits 


As you likely noticed, 6(t) is not actually a function. The more accurate 
statement is that it is a distribution, or a generalized function. There are 
various ways to obtain a mathematically rigorous definition of 6(t), using 
limits or test functions. How limits are used was explained very briefly 
earlier. This will not be pursued any further, but the question does arise 
as to what is permitted when using the delta function. As demonstrated 
in Example 1, linear combinations of delta functions are allowed. It is 
also possible to both differentiate and integrate a delta function. What 
should be avoided is using a discontinuous g(t) in (6.36), and Exercise 7 is 
an example why. Also, what is not allowed, generally, involves nonlinear 
operations. So, expressions such as 6(t — 1)d(t — 2), 6(#— 1) /d(t — 2), and 
sin(d(t—1)) are not allowed. If you are interested in the various properties 
of the delta function, you might look at its Wikipedia page. 
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The nonstandard nature of the delta function amplifies a complication 
with the Laplace transform at t = 0 that needs to be mentioned. It is 
not uncommon in certain applications to use the forcing function f(t) = 
6(t), which means that it is located at t = 0. This puts it at the lower 
point of integration for the Laplace transform. The resulting integral can 
be evaluated using (6.37), giving £(6(t)) = 1/2. However, it is almost 
universally stated that £(d(t)) = 1. One way to explain this involves 
continuity, in the sense that this is what you obtain from Property 13, in 
Table 6.1, when letting a + 0*. On the other hand, one gets £(d(t)) = 0 
when interpreting (6.1) using the conventional definition of an improper 
integral at t = 0. This has lead those determined to obtain £(4(t)) = 1 to 
find some rather creative ways to redefine the Laplace transform. What 
this involves is not considered here, but if you are interested in learning 
more about this issue, you should consult Hoskins [2009]. 


Exercises 


1. Use the Laplace transform to find the solution of the IVP. 
a) . +4y=3H(t-1), y(0)=1 
b) 2y’-y=1-—A(t—4), y(0)=-1 
c) y oe 3), y(0)=-1 
aval Sty 2) ae) y(0) = 0 
) y" —y' — by = 3H(t—5),  y(0) = 0, ¥/(0) = 0 
De a2) sO) 
g) y” —4y' = 36(t— 1), y(0) =0, y'(0) =0 
h) y +y = d(t—3) — 26-2), y(0) =0, y'(0) = 0 


2. Suppose the mixing problem is as described in Example 1 on page 21 
except that 5lbs of salt are dropped into the tank at t = 2min. Solve 
the resulting IVP for Q(t), and then sketch the solution. 


3. Suppose that a population P(t) of fish in a lake, left to themselves, 
will grow exponentially. This means that the population obeys the law 
P'(t) = kP(t). Assume that k = 2, and P(0) = 100. Note that time is 
measured in years. 

a) Suppose that at the end of each year that 500 fish are removed from 
the lake. How does this change the differential equation? What is 
the resulting IVP for P(t)? 

b) What is the solution of the IVP? 


c) The lake is capable of supporting 8,000 fish. In what year does it 
reach this limit? 
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. This exercise considers the vertical motion problems from Section 2.3. 


Assume that a ball with a mass of 2kg is dropped, from rest, from 

a height of 1000m. The forces acting on the object are gravity, and 

a drag force due to air resistance, with c = 5 kg/s. Assume that 

g = 10m/s?. 

a) Suppose that after falling for 10sec that the object is hit with an 
upward force that is equivalent to a delta forcing with strength 70 
N. What is the resulting IVP for v? 


b) What is the solution of the IVP? 


c) What is the resulting solution for x? 


. This exercise reconsiders the cooking the turkey problem in Exercise 


15 on page 32. In that problem it was found that k = 73 In(4/3), 
but is recommended that you leave k unevaluated until part (c). Also, 
time is measured in minutes. 

a) Suppose that the temperature of the oven is accidentally turned 
down to 150°F two hours after the turkey had been put into the over, 
but turned back up to 350°F one hour later. What IVP does the 
temperature satisfy? Assume that the oven temperature changes 
immediately when the temperature control is adjusted. 


b) What is the solution of the IVP? 
c) How long does it take to cook the turkey? 


. Show that the following identities hold for the delta function. Do 


this by showing that when the left and right sides of the equation are 
inserted into (6.35)-(6.37), that they produce the same result. 


a) 6(a(t —to)) = +6(t—to), for a>0 
b) d(to — t) = d(t — to) 
c) If g(t) is continuous, then g(t)d(t — to) = g(to)d(t — to) . 


. In quantum physics there are occasions when the coefficients of the 


differential equation contain delta functions. The point of this exercise 

is to demonstrate that care is needed in such situations. 

a) Consider the problem of solving y(t) = 6(t — to)y(t), for t > 0, 
where to > 0 and y(0) = 1. Using separation of variables, find the 
solution. Make sure to determine its value for 0 < t < to, for t = to, 
and for to < t. This is the correct solution of this problem. 

b) By simply integrating the differential equation in part (a), and then 
using the initial condition, one gets that 


wt) = 1 +f y(r)o(r — to)dr. 
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Not thinking too hard about the situation, and using (6.35)-(6.37), 
explain how you might conclude that 


1 if O<t< ty, 
y= 2 if t= to, 
3 if to <t. 


This differs from the solution for part (a). Where is the error made 
in the derivation of the above solution? 


6.8 = Solving Linear Systems 


The Laplace transform can be used to solve a linear system of differential 
equations, and this is often the approach taken for what are known as 
state space models in engineering. It is relatively easy to do this, and to 
explain why, suppose we want to solve 


xv’ =ax+by+ f(t), (6.40) 
y' = ca + dy + g(t), (6.41) 


where x(0) = xp and y(0) = yo. Taking the Laplace transform of each 
equation, and using (6.8), we get 


sX —% =aX +bY + F, (6.42) 
sY —y =cX +dY+G, (6.43) 


where X, Y, F’, and G are the Laplace transforms of x, y, f, and g, re- 
spectively. What we have shown is that if the original differential equation 
is written as x’ = Ax + f, then the transformed equation is 


sX — x) = AX+F, (6.44) 


where X = L(x), F = L(f), and xo = x(0). This is the form obtained in 
the general case of when there are n equations, and A is an n x n constant 
matrix. 

The next step is to solve for X and Y, and then attempt to find the 
inverse transforms. How hard it is to find the inverse transforms depends 
on f and g. 


Example 1: Using the Laplace transform, solve 


/ 
au =X—Y, 


y = 4x — 2y, 


where (0) = 1 and y(0) = -1. 
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Answer: From (6.42) and (6.43) the transformed equations are 
gx ota Sy 
sY +1=4X — 2Y. 


From the first equation, Y = 1+ (1 — s)X, and after substituting 
this into the second equation, and simplifying, one finds that 


— st3 
ge ge O° 


Since s? + s + 2 = (s — s1)(s — 82), where s; = (-1+%/7)/2 and 
sy = (—1—iv7)/2, then from Property 12 of Table 6.1, 
5 
r=L'X)=e (cos(wt + 5G sin(wt)), 


where w = /7 /2. To find y we can either find the inverse transform 
for Y, or we can use the first differential equation. The latter option 
is easiest, and so 


y=xu-x 
11 
=e t/? (- cos(wt) + oe sin(t). a 


Example 2: Using the Laplace transform, solve 
x = 3x — by + f(t), 
y =x—4y + g(t), 
where x(0) = 0 and y(0) = 0. Also, f(t) and g(t) are continuous 
functions. 
Answer: From (6.42) and (6.43) the transformed equations are 
sX =3X —6Y4+F, 
sY =X —-AY+G. 


From the second equation, X = (s+4)Y —G, and after substituting 
this into the first equation, and simplifying, one finds that 


s—3 1 
= G F(s). 
s?t+s—6 (s) stts—6 (s) 


The convolution theorem is going to be used in finding the inverse 
transform, and in preparation for this note that, using Property 12 
of Table 6.1, 


aa ==) =£\ (Ky) ~ ate e*), 
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and 


c(i) -g0"-) 
Ss i 


So, using the convolution theorem, which is Property 2 of Table 6.1, 


Gare eaahto) = f g(r) 


£1 (35.468) = if : = (e809) — 2-9) g(r har. 


and 


Therefore, the solution is 


t 
y(t) = =a (e2(t-") = e 3") F(r)dr 


1 t 
+5 / (6e-3¢-") - e"—")) g(r) dr. 


To find x you can either find the inverse transform for X, or you 
can use the second differential equation (similar to what was done 
in the previous example). Ml 


6.8.1 - Chapter 4 versus Chapter 6 


In Chapter 4 we solved problems as in Example 1 using an eigenvalue ap- 
proach. In contrast, using the Laplace transform avoids this and it solves 
the problem directly. Moreover, in Example 2, using the Laplace trans- 
form the inhomogeneous problem was solved with little fanfare. This was 
not done in Chapter 4 as it would have involved introducing either unde- 
termined coefficients or variation of parameters. The apparent conclusion 
is that linear systems are more easily solved using the Laplace transform 
than the eigenvalue approach. This is true for systems with two equations 
and the reason is that it is relatively easy to solve for X and Y. However, 
for larger systems the advantage switches to the eigenvalue approach. The 
reason is that larger systems are almost always solved numerically (i.e., 
using a computer). The eigenvalue approach provides a representation of 
the solution (4.24), and it is relatively easy to compute the terms in that 
expression. In contrast, from (6.44), 


X= (s1 = A) 4X0). 


This requires finding the inverse matrix and then trying to determine the 
inverse transform of the resulting formula for X. There are ways this can 
be done, such as using a geometric series expansion for (sI — A)~', but 
how this is carried out is beyond the purview of this textbook. Those 
interested might want to look at Friedland [2005] and Cohen [2007]. 
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Exercises 
1. Use the Laplace transform to find the solution of the IVP, with x(0) = 


4 
(4). 
pfpet, ® a ee ee ee 
oe= (| )5 ax=(; i): ox (4 °)s 
bir = i :)s a= (| aE Lx = & ) 


2. Use the Laplace transform to find the solution of the IVP, where the 
initial condition is x(0) = 0. 


fe 4 1 i Oe 0 At 
Be ty et Les ia eS ae 
er ce 1Ot Pe ce ot 
ea ac VA 2 2 PO Nas 


3. As defined in Section 6.4.1, the transfer function W/(s) is obtained 
from (6.44) by setting xo = O and solving for X. The result is W(s) = 
(sI— A)~!. Find the transfer function for the following systems. 


4. Two tanks containing salt water are connected as shown in Figure 6.5. 
In the lower connecting pipe water is pumped from tank 1 into tank 
2 at a rate of N liters/min, and in the upper pipe water in pumped 
from tank 2 into tank 1 at the same rate. Assume that y;(t) and yo(t) 
are the amounts of salt in the respective tank at time t, and the total 
volume of water in each tank is V liters. You should assume that the 
pipes are so short that whatever water, or salt, in them can be ignored. 


a) Show that the resulting differential equations are 


foe oN on a 
y= yu yr 
N N 


ae —_— —— 
y= V4 y #2 
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Figure 6.5. Two tanks containing salt water as considered in Exercises 4 and 
5. The pipes connecting the tanks are used to pump salt water between the tanks. 


b) Take the Laplace transform of the equations in part (a), and then 
solve for Yi(s). In doing this take N = 2liters/min and V = 
100 liters. Also, assume y;(0) = 10 gm and y2(0) = 0. 

c) Find yi (t) and yo(t). 

d) What are the limiting values of y; and y2 as t > co? Explain why 
this answer is obvious given how the tanks are configured. 


5. Consider the two tanks described in Exercise 4. What is different now 
is that salt water containing 2 gm of salt per liter is poured into tank 
1 at 3 liter/min. Also, the salt water in tank 1 flows out through a 
drain at the bottom at the rate of 3 liter/min. 


a) Explain why the volume in each tank does not change. The differ- 
ential equation for yz is the same as in Exercise 4(a). How does the 
differential equation for y, change? 

b) Take the Laplace transform of the equations in part (a), and then 
solve for Yi(s). In doing this take N = 2liters/min and V = 
100 liters. Also, assume y;(0) = 10 gm and y2(0) = 0. 

c) Find yi (t) and y2(t). 

d) What are the limiting values of y; and y2 as t > co? Explain why 
this answer is obvious given how the tanks are configured. 


6. Two masses m1 and mz are connected by springs as shown in Figure 
6.6. Let ui(t) and u2(t) be the vertical displacements of the upper and 
lower mass, respectively. Using Hooke’s law, the spring forces on m1 
are —kyu, and k2(ug—u1), while the spring force on mg is —k2(u2—u1). 


a) Show that the resulting differential equations are 


mut = —kyu, + k(u2 = U1) 


muy = —kp(ug = U1) 


b) Take the Laplace transform of the equations in part (a), and then 
solve for Uj(s). In doing this take m, = 2, m2 = 1, ky = 4, 
and ky = 2. Also, assume the initial conditions are: u (0) = 0, 
uw, (0) = 1, we(0) = 0, and u5(0) = 0. 

c) Find u,(t) and ua(t). 
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Figure 6.6. Coupled mass-spring system considered in Exercise 6. 


7. Consider the mass-spring dashpot system shown in Figure 6.7. Letting 
u(t) be the vertical displacement of the mass, using F' = ma one finds 
that the differential equations to solve are (Holmes [2019]) 


d 1 
Sey Po 
k Cc 


The task is to find the displacement u(t) and the force f(t). Assume 

that the initial conditions are u(0) = uo, u’(0) = 0, and f(0) = kuo. 

a) Setting v = u’, write the two differential equations in terms of v 
and f. What are the initial conditions? 

b) Take the Laplace transform of the differential equations in part (a) 
and then solve for V(s). In doing this take k = 1, m = 1, and 
uo = 1. 

c) Taking c = 1, find v(t). 

d) Determine u(t). Also, explain how to determine f(t) (you do not 
need to actually find this function). 

e) In Section 3.10.3, the oscillatory solutions occur for smaller values 
of c (what was referred to as under-damped and weakly damped). 
Using your results from part (b), what values of c give rise to an 
oscillatory solution? 


Figure 6.7. Coupled mass-spring-dashpot system considered in Exercise 7. 


Chapter 7 


Partial Differential 
Equations 


A partial differential equation is simply a differential equation with 
more than one independent variable. It is typical that the independent 
variables are time (t) and space (x). If u(x,t) is the dependent variable, 
then examples of partial differential equations (PDEs) are 


Advection Equation: Ut + GUz = 0 
Diffusion Equation: ut = Duge 
Wave Equation: Utt = Cure 


Each of these PDEs is linear and homogeneous. Also, the advection equa- 
tion is first order, while the other two are second order. 

Subscripts are used in the above PDEs to indicate partial differentia- 
tion. There are two other ways this can be done that are very common. 
First, there is the form used in calculus, and examples are 


Ou Ou Oru Oru O7u 
Ot? Ox’? Ot’ OtOx’ Ox?” 


A more contemporary notation is to abbreviate the above expressions, 
and write 


Ou, Ou, Oru, OO,u, Oru. 


x 


All three forms will be used in this chapter. 

In this chapter, at the start, the method of separation of variables is 
used to solve PDEs. Later, in Section 7.7, it will be shown how separation 
of variables leads to another approach, called the Galerkin method. It is 
also possible to use the Laplace transform to solve many of the problems 
considered in this chapter, although that will not be pursued here. 


Introduction to Differential Equations, M. H. Holmes, 2023 
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7.1 » Balance Laws 


The PDEs listed above are the mathematical consequence of a balance 
law, much like the ODEs obtained for simple harmonic motion in Section 
3.10, and the various modeling examples in Section 2.3. For example, 
the wave equation describes the vertical displacement u(x,t) of an elastic 
string. The PDE in this case is a force balance equation coming from 
Newton’s second law F' = ma, where the acceleration is a = uz; and F is 
the vertical component of the restoring force in the string due to its being 
stretched. 

In contrast, the diffusion equation can be used to determine the den- 
sity, or concentration, of objects moving along the x-axis due to Brownian 
motion. The balance law in this case is the requirement that the total 
number of objects is constant, which means that if one region experiences 
an increase, then this is balanced by a decrease in other regions. In older 
textbooks this equation is usually identified as the heat equation. How- 
ever, it has far more applicability than heat propagation, and since about 
1950 it is more often referred to as the diffusion equation. 

Explaining the physical and mathematical assumptions underlying the 
derivation of PDEs is outside the purview of this textbook. If you are 
interested in this you should consult Holmes [2019]. 


7.2 » Boundary Value Problems 


The PDEs listed above involve the spatial variable x. Consequently, it 
is worth first considering how to solve an ODE involving x. A typical 
example is to find the function u(x) that satisfies 


u"—4u=0, for 0<2<2, (7.1) 
where 
u(0)= 1, (7.2) 
and 
u(2) = —3. (7.3) 


This is called a boundary value problem (BVP), and it consists of a 
differential equation and two boundary conditions, one at each end 
of the spatial interval. Because this involves a linear differential equation 
with constant coefficients, the methods developed in Chapter 3 can be 
used to solve it. So, assuming that u = e”™, and then substituting this 
into the differential equation (7.1), you obtain the characteristic equation 
r? = 4. The two solutions are r} = —2 and rg = 2, which means that the 
general solution of (7.1) is 


u=cye + ce". 
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To satisfy the boundary condition at x = 0 we need cy + cg = 1 and 


to satisfy the boundary condition at « = 2 we need cje~4 + cge4* = —3. 
Solving these two equations yields 
ef +3 4 e443 
Cc. = ——— __ and co = —-—{~—_... 
1 64_ e@-4 2 e4 — e-4 


The other methods derived in Chapter 3 are easily modified to solve 
BVPs. As will be demonstrated in Example 1, the method of undeter- 
mined coefficients can be used to solve a BVP. However, a complication 
can arise as it is possible for the boundary conditions to be incompati- 
ble with the differential equation. If this happens then the BVP has no 
solution, and Example 2 is a demonstration of when this can happen. 


Example 1: Solve uv’ — 3u’ + 2u = 42, where u(0) = 3 and u(4) = 0. 


Step 1: The associated homogeneous equation is wu’ — 3u’ + 2u = 0. 
Assuming u = e””, one gets the characteristic equation r? — 3r +2 = 
0. The roots are r = 1 and r = 2, and so up, = cye” + ce?”. 


Step 2: To find a particular solution, we assume that u = Ax+ B. 
From the differential equation, we get that 
—3A + 2(Ax + B) = 4c. 


The coefficients of the respective «” terms on the left and right hand 
sides must be equal, and so we get that: 
tae 2A=4 
rw: -—34+2B=0 
Solving these two equation yields A = 2 and B=3. 
Step 3: The general solution is 


u = 2e4+34 ce + ce”. 


Step 4: For u(0) = 3 we need c; +c = 0, and for u(4) = 0 we need 
11+ cje4 + cge8 = 0. Consequently, c¢, = —c2 = 11/(e*(e*—1)), and 
the resulting solution is 


11 
= 20 +3 (c*-e"). 
U x Weel =A) e€ e€ 


Example 2: Show that uw” + u =0, where u(0) = 1 and u(7) = —3, has 
no solution. 


Ans: Assuming u = e” gives r? = —1, from which we get the 


general solution u = cj cosx + c2sinx. To satisfy u(0) = 1 we need 
c; = 1 and to satisfy u(r) = —3 we need c; = 3. This is not 
possible, and so the BVP has no solution. It is worth noting that 
if u(7) = —3 is replaced with u(a7) = —1 then there are an infinite 
number of solutions. a 
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7.2.1 » Eigenvalue Problems 


We are going to have to consider a particular type of BVP when we solve 
a PDE. An example is the problem of solving 


u"”—\u=0, for 0<2<1, (7.4) 
where 
u(0) = 0, (7.5) 
and 
u(1) = 0. (7.6) 


The function u(x) = 0 is a solution, but what we want to know is whether 
there are nonzero solutions. To be specific, is it possible to find values 
of the constant » so there are solutions that are not identically zero? 
This is the same question asked when solving the eigenvalue problem 
Aa = da. In other words, finding u(x) and . is an eigenvalue problem. 
In this context, the u’s are called eigenfunctions, and the \’s are the 
eigenvalues. A distinctive difference from the matrix eigenvalue problem 
is that there can be an infinite number of eigenvalues for an eigenvalue 
BVP. 

Finding \ and wu is not hard. As usual, assuming that u = e’”, then 
the characteristic equation coming from (7.4) is r? — \ = 0. This means 
that r= +V). Assuming A is a real number then we have the following 
three cases: 


A > 0: In this case, the general solution is u = aev*® + be-V”_ To satisfy 
u(0) = 0 we need a+b = 0, and for u(1) = 0 we need aeV+be-V> = 
0. So, b = —a, and this means that a(eV¥* — e~V*) = 0. Since 
ev # eV» when \ > 0, the conclusion is that a = 0, and this 
means we just get the zero solution. 


\ = 0: The general solution of (7.4) is u = a+ ba. To satisfy u(0) = 
we need a = 0, and for u(1) = 0 we need a+b=0. So,a=b= 
and this means we just get the zero solution. 


\ <0: Setting \ = —k?, where k > 0, then r = +ik. This means that 
the general solution of (7.4) is 


u(x) = acos(kx) + bsin(ka). 


To satisfy u(0) = 0 we need a = 0. To satisfy u(1) = 0 we need 
bsin(k) = 0. To obtain a not identically zero solution for u(x) we 
take k so that sin(k) = 0. This holds if any one of the following 
values are used: 

k=, 27,37,.... 
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The conclusion is that the eigenfunctions are 
Un(x) = bp sin(n7z), (7.7) 


where b,, is an arbitrary nonzero constant, and the associated eigenvalues 
are 


An = —(nr)’, (7.8) 
forn = 1, 2,3,.... 


Skipping the Two Real Roots Case 


An observation can be made that will simplify solving an eigenvalue prob- 
lem. In the above example, when there were two real-valued solutions for 
r, we ended up with the zero solution. This always happens when using 
the boundary conditions (7.5) and (7.6). In fact, it always happens for 
any of the boundary conditions considered in this textbook. As a sam- 
pling of what sort of boundary conditions this can include, look at those 
in Exercise 3. So, in this textbook, the two real roots case can be skipped. 
For example, if the characteristic equation is r? = —, then to skip the 
two real roots case it will be assumed that ’ > 0. Similarly, if the char- 
acteristic equation is r? + \r +4 = 0, then r = 5(—A+ VA? — 16), and so 
skipping the two real roots case means that it is assumed that \?7—16 < 0. 


Example 3: Find the eigenvalues and eigenfunctions of wu’ —4u'/+Au = 0, 
for 0 < a < 2, where u(0) = 0 and w’(2) = 2u(2). 


Answer: Assuming u = e™, then from the differential equation the 
characteristic equation is r? — 4r + \ = 0. From this we get that 


r=2+vV4-.X. 


Skipping the two real roots case, it is assumed that 4 — A < 0, or 
equivalently \ > 4. 


A =4: In this case r = 2, and from (3.19) we get that the general 
solution is u = ae?” + bre?”. To satisfy u(0) = 0 we need 
a = 0. For u’(2) = 2u(2) we need 5be* = 4be*, which means 
that b = 0. So, we just get the zero solution. 

\>4: Setting 4— \ = —k?, where k > 0, then r = 2+ik. From 
(3.21), the general solution is 


u(x) = ae?* cos(ka) + be?” sin(kar). 


To satisfy u(0) = 0 we need a = 0. To satisfy u/(2) = 2u(2) we 
need 2be* sin(2k) = 2be* sin(2k) + be* cos(2k). To obtain a not 
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identically zero solution we take k so that cos(2k) = 0. This 


holds if k = 7, ar oF ..., which can be written as: 


kn = (2n- 1), for n = 1,2,3,---. 


The resulting eigenfunctions are un(x) = b,e?” sin(kyz), and 
the associated eigenvalues are \, =4+k2. ll 


Rayleigh Quotient 


It is possible to show that the eigenvalues for the above BVP must be 
negative, without having to first derive the formula for them. This can 
be done using what is called the Rayleigh quotient, and this is explained 
in Exercise 4. In fact, the steps in this exercise can be modified to also 
prove that the eigenvalues must be real-valued, which is an assumption 
we made in solving the eigenvalue problem. 

The Rayleigh quotient is more than a theoretical tool as it plays an im- 
portant role when studying mechanical vibrations as well as when finding 
quantum energy levels. It is also used extensively in scientific computing 
when solving eigenvalue problems. 


Exercises 


1. Solve the given BVP. 
a) Coe for 0 <a <1; u(0) =0 and u(1) = 1. 
b) u” — 9u = 0, for 0 < x < 1; u(0) = 0 and u/(1) = —3. 
c) u” — 2u’ + 5u = 0, for 0 < x < 2; u(0) = 0 and u(2) = 1. 
) uw’ —u=5, for 0 < x < 2; u(0) = 0 and u(2) = 0. 
e) as = 2r, for0 <a <1; u’(0) =0 and u(1) = 1. 
f) u’ — 6u' + 8u = 8sin(4z) + 24cos(4x), for 0 < x < 7; u(0) = 0 and 
un) =A, 
2. Show that the given BVP has no solution. 
a) u’ + 9u = 0, for 0 < x < a; u(0) = 2 and u(7) = 1. 
b) 4u” + u = 0, for 0 < a < 7; u(0) = —1 and u/(r) = 4 
c) 4u” + x?u =0, for 0 < x < 1; u'(0) = 0 and u(1) = —3. 

3. Find the eigenvalues and eigenfunctions of the given BVP. You can use 
the “skip the two real roots” simplification, just make sure to state the 
resulting assumption on 4. 

a) u” = Yu, for 0 < x < 1; u(0) = 0 and u’(1) = 0. 
b) a! =u tor 0 <a < Aca 0) = 0 anda’ (4) = 0: 
c) u” + Au’ +u=0, for 0< ax < 4; u(0) = 0 and u(4) = 0. 


Qa 
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d) u” + 2u’ = Au, for 0 < « < 1; u(0) = 0 and u(1) = 0. 
e) u” + Au = 0, for 0 < x < 1; u(0) = u(1) and u’(0) = u’(1). These 
are called periodic boundary conditions. 


4. This exercise explores the usefulness of what is known as the Rayleigh 
quotient for the eigenvalue problem (7.4)-(7.6). 


a) If you multiply (7.4) by u, and then integrate over the interval, you 
get Jo (uu — \u?)dx = 0. From this show that 


Jo (ul Pde 


il udxr 


This is the Rayleigh quotient for this problem. 

b) Use part (a) to explain why, given an eigenfunction u(x), that the 
associated eigenvalue must be negative. 

c) The fundamental eigenvalue corresponds to the case of n = 1 in 
(7.7). Taking 6; = 1, sketch u;(x) for 0 < x < 1. On the same 
axes, also sketch w(x) = 4a(1— 2). 

d) Part (c) shows that w(x) can be used as an approximation of u;(x). 
Use w(x) in the Rayleigh quotient to obtain an approximation for 
1. This is often used in quantum and classical mechanics to esti- 
mate an eigenvalue without actually solving the differential equa- 
tion. 


7.3 =» Separation of Variables 


The solution method will be introduced by using it to solve a problem 
involving the diffusion equation. This requires a correctly formulated 
problem, and the one considered is to find the function u(z, t) that satisfies 


2 
Oru Ou for ee (7.9) 


dx? Ot’ Ot, 


In this equation, the positive constant D is the called the diffusion coef- 
ficient. To complete the formulation we will prescribe the values of u at 
the two endpoints, where x = 0 and x = JL, and at the beginning, when 
t = 0. Specifically, for boundary conditions it is assumed that 


u(0,t) =0, (7.10) 


and 
u(L;t) = 0. (7.11) 


For the initial condition, it is assumed that 


i(70) = o(e);. for Oa bs, (7.12) 
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where g(z) is a given function. 

The fact that wu = O is a solution of the PDE and the boundary 
conditions is required for the method of separation of variables to work. 
The reason is that this will enable us to use the principle of superposition. 
So, if the left boundary condition is changed to, say, u(0,t) = 1, or the 
PDE is changed to, say, Dusz = ut + x, then separation of variables 
will not work. What is necessary in these cases is to first transform the 
problem into one where u = 0 is a solution of the PDE and boundary 
conditions. How this is done is considered in Sections 7.6 and 7.7. 


7.3.1 » Separation of Variables Assumption 
The assumption is simply that 
u(x,t) = F(x)G(t). (7.13) 
Substituting this into the PDE (7.9) gives DF" (x)G(t) = F(x)G'(t). 
Separating variables yields 


F(x) Gi(t) 
Daa = aa (7.14) 


Now comes the key observation. The only way a function of 7 can equal 
a function of t, since x and ¢ are independent, is that the function of x is 
a constant, the function of t is a constant, and the constants are equal. 
In other words, there is a constant A so that 


F"(z) = 
Pray 
and Git) 
Gif) =x. 
These can be rewritten as 
DF" (x) = \F(2). (7.15) 
and 
G'(t) = AG(t). (7.16) 


The A appearing here is called, not surprisingly, the separation con- 
stant. 


7.3.2 « Finding F(a) and 


The separation of variables assumption must be applied to the boundary 
conditions. So, to have u(0,t) = 0, we need F(0)G(t) = 0. For this to 
happen, and for u to not be identically zero, we require that F'(0) = 0. 
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Similarly, we need F(L) = 0. Consequently, all-together, the function 
F(x) must satisfy 


DF"(z) =dF (a); tor 0 <a < L, (7.17) 

where 
F(0)=0 and F(L)=0, (7.18) 
The solution of this BVP depends on whether A is zero or not. So, we 


have two cases to consider. 


\ = 0: In this case (7.17) is F” = 0, and so F(x) = a+ bz. To satisfy 
F(0) = 0 we need a = 0, and for F'(L) = 0 we need b = 0. So, we 
just get the zero solution in this case. 


\ #0: Assuming F(x) = e’, then (7.17) reduces to Dr? = X. We will 
skip the two real roots case, which means we only consider ’ < 0. 
Setting 1 = —k?, where k > 0, then Dr? = —k?. This means that 
r= +ik/VD. The resulting general solution of (7.17) is 


F(a) = acos(ka/VD) + bsin(kx/VD). 


To satisfy F'(0) = 0 we need a = 0. To satisfy F(L) = 0 we need 
bsin(kL/VD) = 0. To obtain a function F(«) that is not identically 
zero, we take k so that sin(kL/VD) = 0. This holds if any one of 
the following values are used: 


kL/VD = 1, 2m, 3m,..., 


or equivalently 


tVD 321V/D 3nVD 


= jkthes wl 
i Te ade Fie ey 
The conclusion is that the not identically zero solutions of (7.17) and 
(7.18) are 
F(a) 0, sin(“**), (7.20) 
and 5 
nT 
ereset p() 7.21 
d : (7.21) 
for n = 1, 2, 3,.... Also, b, is an arbitrary constant. 
7.3.3 » Finding G(t) 
For A = Xn, the general solution of (7.16) is 
Gina me") (7.22) 


where a, is an arbitrary constant. The function G,,(t) is not required to 
satisfy the initial condition (7.12); that condition will be satisfied once we 
determine the general solution. 
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7.3.4 » The General Solution 


We have shown that for any given n, the function u,(z,t) = F,(x)Gn(t) 
is a solution of the PDE that satisfies the boundary conditions. Because 
the PDE and boundary conditions are homogeneous, and the problem is 
linear, the principle of superposition can be used (see page 5). There- 
fore, the resulting general solution, that satisfies the PDE and boundary 
conditions, is 


Ut t= Ss" Unt); 
n=1 


or equivalently 
(oe) 
tet) = d, bnern® sin(“**), (7.23) 
n= 


where b,, is an arbitrary constant, and ,, is given in (7.21). In writing 
this down, the constant a, in (7.22) has been absorbed into the by. 


7.3.5 = Satisfying the Initial Condition 


It remains to satisfy the initial condition, which is u(#,0) = g(x). Ac- 
cording to our solution in (7.23), we need 


Ss bn sin( =) = g(x). (7.24) 
n=1 


This is the equation that is used to determine the b,’s. However, the 
left-hand-side is an example of what is known as a Fourier series. More 
specifically, it is an example of a Fourier sine series. There are some 
significant mathematical questions that arise here, one of which is whether 
the series converges. This, and some related questions, are addressed in 
the next section. For the moment, we simply state the conclusion. If g(x) 
is continuous, except perhaps for a few jump discontinuities, then 


= 2f g(x) sin(“**) de. (7.25) 


7.3.6 » Examples 


Example 1: Suppose that D = 1, L = 2, and g(x) = 3sin(zz). In this 
case, from (7.21), An = —(n7/2)?, and the resulting general solution 
(7.23) is 


(oe) 
Ul pet) = Ss bye 4 sin(“**). 
n=1 
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Solution 


0.24 


Solution 


To satisfy the initial condition, it helps to notice that g(x) is one 
of the sine functions in the series. To make this more evident, the 
requirement that u(z,0) = g(a) means that we need 


> bn sin(“*) = 3sin(72), 
n=1 


or equivalently 
3 
by sin(*) +b2 sin(7x)+b3 sin(—*) +b4sin(27x)+--- = 3sin(7z). 


To satisfy this equation, take b2 = 3 and set all the other 5,’s to 
zero. Therefore, the solution is 


Ut) = ae°"* sin(72). (7.26) 


This solution is shown in Figure 7.1, both as time slices and as the 
solution surface for0<t<0.24. Hf 


t-axis x-axis 


x-axis 


Figure 7.1. Solution of the diffusion equation in Example 1. Shown is the 


solution surface as well as the solution profiles at specific time values. 
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Example 2: Suppose that in the previous example, 


g(z) = 3sin() 4sin(*") + 5sin(272). 


This is an example of when g(x) involves the sum of three of the 
sine functions in the series. The requirement is that 


(oe) 
be sin(“*) = 3sin(S) 4sin(*5) + 5sin(272). 
n=1 


To satisfy this we take b; = 3, b3 = —4, b4 = 5, and all the other 
b,’s are zero. The resulting solution is 


u(x,t) = Se" */4 sin() ee sin(=*) 


—Ant 


+ 5e sin(277). Ml 


Example 3: Suppose that D=1, L =1, and 


1 if b<q7< 2 
Boe SS BS 
-_ 7.27 
97) 0 otherwise. ( ) 


In this case, it is necessary to use (7.25) to find the b,’s. Carrying 
out the integration 


2/3 
by = 2 | sin(niax)dx 
1/3 


= = (cos(nn/3) = cos(2nm/3)). 


As for the solution, since An = —(n7)?, then 


= Sohne rt ein (nr2). (7.28) 


This solution is shown in Figure 7.2 forO<t<0.1. 


Exercises 


1. You are to find the solution of the diffusion problem for the following 
initial conditions. Assume that LD = 1 and D = 3. Note that you 
should be able to answer this question without using integration. 


a) g(x) = —4sin(5ra). 
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Solution 


0.4 


t-axis x-axis 


Solution 


x-axis 


Figure 7.2. Solution of the diffusion equation in Example 8. Shown is the 
solution surface as well as the solution profiles at specific time values. 


b) g(x) = 6sin(1172). 
c) g(x) = sin(mxz) + 8sin(472) — 10sin(772). 
d) g(x) = —sin(37x) + 7sin(87x) + 2sin(1572). 


e) g(x) = 4sin(272) cos(72). 


2. You are to find the solution of the diffusion problem for the following 
initial conditions. Assume that L = 2 and D = 4. 


ae) = 0 otherwise 


ae if 0<2<§ 


c) g(x) = cos(mz) Oe 5 tiaras 


3. Find the solution of 


O7u = Ou ; a 


ax? Ot’ 0<¢, 


where u(0,t) = 0, u(3,t) = 0, and u(a,0) = —5z. 
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. Find the solution of 


0<24< 2, 


100?u = du, for ves 


Lat 2 Sas 3 


where u(0,t) = 0, u(2,¢) = 0, and u(x,0) = { O° athereiee 


. Find the general solution of the following. 


a) Ure = Uz, for 0 < x < 1, with the boundary conditions u(0,t) = 0 
and u,(1,t) = 0. 

b) 4uz2 = uz, for 0 < x < 1, with the boundary conditions u,(0,t) = 0 
and u(1,t) = 0. 

c) (1+1t)02u = Ou, for 0 < x < 1, with the boundary conditions 
u(0,t) = 0 and u(1,t) = 0. 

d) Ure = uy + e tu, for 0 < x < 1, with the boundary conditions 
u(0,t) = 0 and u(1,t) = 0. 


. Find the solution of the problem for the given initial condition. 


a) Exercise 5(a), with u(x, 0) = 3sin(%¢) — 7sin(234). 
b) Exercise 5(b), with u(z,0) = —5 cos(2%4) — 2cos(4£). 
c) Exercise 5(c), with u(x,0) = 14sin(1072) + 30sin(1872). 
d) Exercise 5(d), with u(xz,0) = —24sin(37x) — 12sin(157z). 


. Find the resulting ODEs obtained using separation of variables on the 


given PDE. 
a) (1+ 2)Uce + tu = Tu, assuming u = 
b 
c 
d 


e 


()G() 
(9) 
)G(t) 
+ 3zuz = Uy + 9u, assuming u = Z(z)Y(y) 


F 
7 Urp + 7Uy + Ugg = 0, assuming u = R(r)O 
(e7Oz,u) = (1+ x?)Ou, assuming u = F(x 


) 
) a 
) 
ju 


24+ u? =e tu’, assuming u = F(x)G(t) 


7.4 » Sine and Cosine Series 


To satisfy the initial condition for the diffusion problem considered in the 
previous section, we were required to find the b,,’s so that 


37 sin("™), for 0< a <L. (7.29) 


This is an example of a Fourier sine series. Finding the b,’s is not hard. 
However, this requires knowing what restrictions must be placed on g(x), 
and so, this is where we begin. 


One of the requirements is that g(x) is piecewise continuous for 0 < 


x < L. As explained in Section 6.3, this means that g(x) is continuous 
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except, possibly, for a finite number of jump discontinuities. To state 
that g(a) has a jump discontinuity at « = a means that g(x) is not 
continuous at « = a, but the limits of g(x) from the left, g(a~), and from 
the right, g(a‘), are defined and finite. This is the requirement when 
0<a<L. For x =0, then g(0*) must be defined and finite, but it is not 
required to equal g(0). Similarly, for x = L, g(L~) must be defined and 
finite, but it is not required to equal g(L). As an example, the function 
in (7.27) has a jump discontinuity at x = 1/3 and at x = 2/3. 

A consequence of the assumption that g(a) is piecewise continuous is 
that the integral in (7.25) is well-defined. 


7.4.1 « Finding the b,,’s 


The working hypothesis is that the sine series converges, and we can 
integrate it term-by-term. The reason for this assumption is that the 
key for finding the coefficients is the integration formula: if m and n are 
positive integers, then 


L ; 
[ sin(“*) sin(“* ae a 2 oe (7.30) 
: 0 if m#n. 


The derivation of this formula is often done when covering integration 
techniques for trigonometric integrals in calculus, and it involves using 
the identity sin ax sin bx = $[cos(a — b)x — cos(a + b)a]. 

To illustrate how (7.30) is used, suppose we want to find the value for, 


say, b7. Multiplying (7.29) by sin(77a/L), and then integrating yields 


[ g(x) sin( 7) dx = yt ie sin(™*) sin( “J dz. 


According to (7.30), all of the integrals on the right are zero except when 
n = 7. Consequently, 


or equivalently 


Oa ia (INL 
n==f g(e) sin( ) der. 


A similar result is obtained for the other b,’s, and the resulting formula 
is 


b= 2f g(x) sin(“"* ) dv. (7.31) 
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7.4.2 » Convergence Theorem 


Proving a sine series converges requires more than just using the ratio 
test, which is the way you prove a power series converges. The proof is 
beyond the scope of this textbook, but the result is important for our 
using a sine series when solving PDEs. 


Sine Series Convergence Theorem. Assume that g(x) and g'(x) are 
piecewise continuous for0 <a < L, and the b,,’s are given in (7.31). 


For0<a< L: If g(x) is continuous at x, then 
oS NTx 
A Bis sin(“**) = g(a); (7.32) 
nel 

and if g(x) has a jump discontinuity at x, then 

= NTL 1 

Sb sin( =) = 5[o(e*) + 9(@")]. (7.33) 

n 

At x=Oorx=L: The sine series is zero when x =0 orx=L. 


In words, the theorem states that the sine series equals the function g(x) 
at points in the interval where g(x) is continuous, and it equals the average 
in the jump of g(x) at a jump discontinuity. At the endpoints, no matter 
what the value of g(0) or g(L), the series sums to zero. 


7.4.3 » Examples 


Finding a sine series is rather uneventful as it is simply a matter of eval- 
uating the given formulas. The only concern is how hard it is to evaluate 
the integrals to find the coefficients. So, in the examples below, a more 
practical question is also considered. Namely, how many terms of the 
series do you have to add together to obtain an accurate approximation 
of the function g(x)? As will be seen, the answer depends on whether 
the function is continuous, and whether it has the right values at the 
endpoints. 


Example 1: Taking L = 3, suppose 


on x if 0O<27<2, 
ST SE eee a. 


Sketch the function that the sine series converges to for 0 < x < 3. 


Answer: It is recommended that you first sketch g(x), which is 
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g(x) 


x-axis 


Sine Series 


x-axis 


Figure 7.3. The function that the sine series sums to in Example 1. 


done in the top plot in Figure 7.3. The function that the sine 
series converges to is the same except at jump discontinuities, and 
possibly at the endpoints. For this g(x), at x = 2 the series sums 
to the average $[9(2*) + g(2-)] = $(1+2) = 2. At both endpoints 
it sums to zero. The sketch of the resulting function is given in the 
bottom plot in Figure 7.3. 


Example 2: For 0 < x < 1, find the sine series of 


Oo 3n if O 
Yl — 

# 3-2) if i 
Answer: Using (7.31), and integrating by parts, 


1/3 1 
— 6 | xsin(nra)dx + 3 | (1 — x) sin(n7x)dx 
0 1/3 


9, 
=a sin(n7/3). 


Because g(a) is continuous, and g(0) = g(1) = 0, we have that 


9 
g(x) = > =,2 sin(n7/3)sin(ntx), for O< a <1. (7.34) 
n=1 
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Figure 7.4. Comparison between the function g(x) in Example 2, shown with 
the dashed blue curve, and the sine series approximation in (7.85), shown using a solid 
red curve. 


When computing the value of the sine series it is necessary to pick 
an N, and then use the approximation 


N 


9 
g(x) & d nt sin(n7/3) sin(n72). (7.35) 
The accuracy of this is shown in Figure 7.4. It is evident that for 


smaller values of N the approximation is not very good, but it is 
not bad for N= 27. 


Example 3: For 0 < x < 1, find the sine series of 


L %w0ee<4, 
we)= | : 


otherwise. 


Also, sketch the function the sine series converges to for 0 < x < 1. 
Answer: Using (7.31), 


1/4 9 
= a sin(nmx)dxz = —|1—cos(n7/4)]. 
(0) NT 
From this we have that, except for x = 0 and « = 1/4, 
[o-e) 


oe) = S> = [1 — cos(nm/4)] sin(n7a). 


n=1 


(7.36) 


7.4. Sine and Cosine Series 207 


Sine Series 
f=} 
ol 


= e | 

0¢@ Q— 
| | | 

0.25 0.5 0.75 1 


x-axis 


Figure 7.5. The function the sine series in Example 3 converges to for0 <a <1. 


At x = 0 the series is zero, and at « = 1/4 the series sums to 1/2, 
which is the average in the jump of g(x) at this point. The resulting 
function is shown in Figure 7.5. 


The resulting approximation is, given N, 


2 
rd —|1—- 4)| si Tat 
g(x) ss = cos(n7 / )] sin(n7x) ( ) 
The accuracy of this is shown in Figure 7.6. Because of the jump in 


the function, the sine series requires a larger value of N than needed 


= 
za 
i 
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Figure 7.6. Comparison between the function g(x) for Example 38, shown 


with the blue curve, and the sine series approximation in (7.87), shown using the red 


curve. 
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in Example 2 to provide an accurate approximation. However, even 
with a larger N, the series has difficulty in the immediate vicinity of 
the jump. It has the same problem near x = 0 since the series is zero 
at x = 0 but g(0) = 1. The larger oscillations near the jump points 
are associated with what is called Gibbs phenomenon. As can 
be seen in the figure, the region where these oscillations occur can 
be reduced by taking larger values of N. However, the maximum 
overshoot and undershoot on either side of the jump do not go to 
zero. Instead, for 0 < x < L, they approach a value that is equal to 
about 9% of the jump in the function. Because jump discontinuities 
arise so often in applications, there has been considerable research 
into how to remove the over and under shoots in the Fourier series 
solution. One of the more well known methods involves filtering 
them out, and an example is Fejér summation. More about this can 
be found in Jerri [1998]. 


7.4.4 « Cosine Series 


Using separation of variables, it is not uncommon to end up with a cosine 
series rather than a sine series. In this case, the initial condition requires 
finding the an’s that satisfy 


1 a NTL 
Ce 300 par cos(“**), for O<a<L. (7.38) 


The convergence theorem for this is very similar to the one for the sine 
series. First, the needed integration formula is, if m and n are integers, 


L if m=n=0, 
s L 
/ cos (“2 ) cos(™) de = 5 if m=n #0, (7.39) 
0 if m#n. 


The derivation of this formula is a straightforward calculation using the 
identity cos ax cos bx = (cos(a — b)x + cos(a + b)x)/2. This formula is 
used in the same way the one for the sine series was used. Namely, if you 
want to determine, say, a4, you multiply (7.38) by cos(47a/L) and then 
integrate over the interval 0 < x < L. The resulting formula, for general 
n, is 


n= 2f g(x) cos(“E) ae. (7.40) 


This brings us to the next result. 
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Cosine Series Convergence Theorem. Assume that g(x) and g'(«) 
are piecewise continuous for0 <a < L, and the ay’s are given in (7.40). 
If g(x) is continuous at x, then 


1 [o-e) 
30 + s Din, cos("*) = Oe |; (7.41) 
n=1 
If g(x) has a jump discontinuity at x, and0<a< L, then 
=e5 + 3 in cos(“**) = * Ig(at) + g(z~)]. (7.42) 
2 = L 2 


At x = 0, the series sums to g(0T), and at x = L, the series sums to 
g(L~). 


In words, the theorem states that the cosine series equals the function 
g(x) at points in the interval where g(x) is continuous, and it equals the 
average in the jump of g(x) at a jump discontinuity. At the endpoints, it 
sums to the respective limit of g(x) at the endpoint. 


Example 4: For 0 < x < 1, find the cosine series of 


c+l1 if O<a<5, 
g(x) = a 
2 i See 1 


Answer: Using (7.40), if n 4 0, 


1 
= mo g(x) cos(nrax)dx 
0 


le 1 
(x + 1) cos(n7a)dx + 2 | 2cos(nmax)dx 


1/2 


os 


2 T 
be Oo 
o 
5 e 
77) 
® 1.5 - 
& 
” 
° 
oO 
1 ra 
| 
0 0.5 1 
X-axis 


Figure 7.7. The function the cosine series in Example 4 converges to forO<a <1. 
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Figure 7.8. Comparison between the function g(x) for Example 4, shown 
with the blue curve, and the cosine series approximation in (7.44), shown using the red 


curve. 


and when n = 0, a9 = 13/4. From this we have that, except for 
= 1/2, 


g(x) = > + % [3 (cos (>) 1) — sin (=)| cos(nr2). 
-_ (7.43) 


At x = 1/2 the series sums to the average in the jump in g(x), and 
so it equals 7/4. The resulting function is shown in Figure 7.7. 


The resulting approximation is, given N, 


= 13 al 2 nT 1 . ont 
g(x) © a + > |= (008 ( 5 ) 1) - sin ( 5 )| cos(nrz). 
(7.44) 
The accuracy of this is shown in Figure 7.8. As happened with 
the sine series, in the immediate vicinity of the jump the series 
oscillates. However, unlike Example 3, there are no oscillations at 
the endpoints. 
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7.4.5 » Differentiability 


In using a sine or cosine series when solving a PDE, it is implicitly assumed 
you can differentiate the series term-by-term. What this means is that it 
is assumed that 


With this in mind, in Example 3, if you try this with (7.36), you get 
=o 7 (1 — cos(n7/4)) cos(nma). (7.45) 


As you should recall, if an infinite series }> a, converges, then it must be 
true that a, — 0 as n — oo. The above series for g'(x) does not satisfy 
this condition, and therefore it does not converge. In other words, you 
can not differentiate (7.36) term-by-term. In contrast, for Example 2 you 
can differentiate the series term-by-term. The theorem that explains this 
states that if g(x) is continuous, and g/(x) is piecewise continuous, for 
0<a< JL, then you can differentiate the cosine series term-by-term. You 
can differentiate a sine series term-by-term if it is also true that g(0) = 
g(L) = 0 [Tolstov and Silverman, 1976]. This holds for Example 2, and 
that is why term-by-term differentiation can be done with that sine series. 
For both the cosine and sine series, if g(x) is not continuous, then term-by- 
term differentiation is not possible without additional assumptions. Those 
interested in pursuing this issue a bit further should look at Exercise 11. 

The situation for term-by-term integration is better. Specifically, if 
g(x) satisfies the requirements of the convergence theorem, its sine, and 
cosine, series can be integrated term-by-term. 

The next question is whether the potential non-differentiability of a 
sine series means that we can not use it to solve the diffusion equation. 
To explain why this is not a problem, consider the solution (7.43), which 


is 
[oe) 
= he mt sin(nraz). 


As long as t > 0, the coefficients of this series are exponentially decreas- 
ing functions of n?. This, along with the fact that the series for g(x) 
converges, guarantee that you can differentiate the series term-by-term 
without reservation, as long as t > 0. 


7.4.6 = Infinite Dimensional 


For vectors in R?, the dot product is used to determine orthogonality. As 
you should recall, x and y are orthogonal if x-y = 0. Also, any vector 
in R? can be written in terms of the three coordinate vectors i, j, and k. 
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This means that it is possible to write x as a linear combination of these 
vectors: x = ri+ yj + zk. In this sense, i, j, and k are a basis for R®. 
In fact, since i, j, and k are orthogonal to each other, they form what is 
called an orthogonal basis. Because there are three vectors in the basis, 
IR® is three dimensional. 

Now, the Sine Series Convergence Theorem states when a function 
g(x) can be written as a linear combination of the sine functions sin(z2/L), 
sin(27a/L), sin(37xr/L),---. There is also a dot product, or what is usu- 
ally called an inner product, for the sine functions, and it involves the 
integral appearing in the integration formula in (7.30). According to this 
integration rule, the sine functions are orthogonal to each other. This 
means that sin(rx/L), sin(272/L), sin(37x/L), --- is an orthogonal ba- 
sis. Because this basis contains an infinite number of elements, the space 
we are considering is infinite dimensional. This viewpoint gives rise to 
what is called a Hilbert space, and these play a fundamental role in many 
areas in science and engineering. For an introduction to Hilbert spaces 
and partial differential equations, you might consult Gustafson [1999]. 


Exercises 


1. Sketch the graph of f(a) for 0 <a <1. Also, determine whether f() 
is continuous, piecewise continuous, or neither for 0 < x < 1. 


L Oss 0: ae 0 
ap f@y=4 Ww it F<e2<3 oO f@=H=* he ft O<e<1 
3 if $<a<1 it aed 
1 if c=4,3,3,1 0 if 0<a<s 
5 = 4724 gq = a 
) I) 1; otherwise ) £(@) an if 5<a<l 


2. Assuming that L = 2, explain why g(x) does not satisfy the conditions 
stated in the Sine Series Convergence Theorem. 


a gaa? b) g(x) = tanz c) g(x) = yaeci 
3. In the following, g(x) and g’(x) are piecewise continuous. Assuming 


that L = 2, sketch the function to which the sine series converges, for 
0<a< 2. The Heaviside function H(x) is defined on page 169. 
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Dap ar DS pe i ap bees 
= =H . = g>=Us9 

8) 9() 0 if l<a<2 i) g(2) 0 otherwise 
eo oe 
hb) g@y=y 0 VO SESE ae aes 
aa x otherwise j) 92) = ‘ gs 


4. Find the sine series for the functions in Exercise 3. 


5. For the functions in Exercise 3, sketch the function to which the cosine 
series converges, for 0 < x < 2. 


6. Find the cosine series for the functions in Exercise 3. 


7. For any given x from the interval 0 < x < 1, use the comparison test 
to show that the series in (7.34) converges absolutely. 
8. In this exercise let g(x) = x7, forO< a < 1. 


a) Find the cosine series for g(r). 


b) For any given x from the interval 0 < x < 1, use the comparison 
test to show that the series in part (a) converges absolutely. 


c) Using your result from part (a), show that 


ener 2 


= TW 
ae aa 


9. In this exercise let g(x) =z, forO <a <1. 
a) Find the sine series for g(x). 


b) Using your result from part (a), show that 


10. Find a function g(x) that is continuous for 0 < x < 1, except for a 
jump discontinuity at « = 1/2, and which equals its sine series for 
O<a2a<l. 

11. This exercise deals with the restriction on term-by-term differentiabil- 
ity of the sine series. This requires you to have read Section 6.7.1. If 
the observation made in this exercise interests you, you might want to 
look at Stakgold [2000]. 


a) Write the function g(x) in Example 3 in terms of the Heaviside 
function H(z). 


b) Using Example 4, from Section 6.7.1, what is g/(x)? 


c) Using your result from part (b), what is the sine series for g’(x)? 
How does this differ from the result in (7.45)? 
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7.5 » Wave Equation 
The problem involves finding the function u(x,t) that satisfies 


Ou Pu Ox ae Tn 
Cao = 9p for { O<t (7.46) 
where c is a positive constant. This PDE is known as the wave equation. 
It applies, for example, to the vertical displacement u(z,t) of an elastic 
string. This provides an interesting interpretation of the terms in the sine 
series solution, and this is discussed in Section 7.5.2. 

To complete the problem, the boundary conditions are 


u(0, t) = 0, (7.47) 
and 
u( bt) = 0; (7.48) 
For the initial conditions, it is assumed that 
u(z,0)= g(x), for 0<a<L, (7.49) 
and 
i CEO) == fila). for Or ges Dy, (7.50) 


where g(x) and h(a) are given functions. To avoid the complication with 
differentiability, as described in Section 7.4.5, it is assumed that g(x) 
and h(x) are smooth functions that satisfy the boundary conditions, and 
¢'(0) = 9"(L) =0. 

As with the diffusion problem, separation of variables will be used to 
find the general solution of the PDE and boundary conditions. After that, 
the initial conditions will be satisfied. Also, you should notice, as with the 
diffusion problem, the PDE and boundary conditions are homogeneous. 
This is required for separation of variables to work. 


Separation of Variables Assumption 


Assuming 
u(z,t) = F(x)G(e), (7.51) 
and then substituting this into the PDE gives us 
2F"a) _ GN) 
F(z) G(t) 


Since the left-hand-side is only a function of x, and the right-hand-side is 
only a function of t, we can conclude that there is a constant A so that 


CF" (x) = F(a), (7.53) 


(7.52) 


and 


G" (t) = AG(t). (7.54) 
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Finding F(x) and 


The separation of variables assumption must be used on the boundary 
conditions. So, to have u(0,t) = 0, we need F'(0)G(t) = 0. For this to 
happen, and wu not be identically zero, we require that F'(0) = 0. Similarly, 
we need F(L) = 0. Consequently, all-together, the function F(x) must 

satisfy 
2F" (2) = AF(ax), (7.55) 

where 
F(0)-=0" and: FUL) = 0, (7.56) 


The only difference between the above BVP, and the one for the diffu- 
sion equation, is that we now have the coefficient c* instead of D. Conse- 
quently, from (7.20) and (7.21), the nonzero solutions of (7.55) and (7.56) 


are saints 
Fy (a) = Bn sin(“**), (7.57) 
and . 
ie -o(=) (7.58) 
for n = 1, 2,3, .... Also, bp, is an arbitrary constant. 
Finding G(t) 


Now that we know \, (7.54) takes the form 


NT 


an =-2(% ) aw) 


Assuming that G(t) = e™, we get that r? = —(enm/L)?. So, r = 
+icni/L, and from this we get the general solution 
Gi(t) = an cos(Wyt) + bp sin(wpt), (7.59) 
where ne 
Wn = 5 (7.60) 


and a, and by, are arbitrary constants. 


The General Solution 


We have shown that for any given n, the function u,(xz,t) = F,(x)Gn(t) 
is a solution of the PDE that satisfies the boundary conditions. The re- 
sulting general solution, that satisfies the PDE and boundary conditions, 
is, therefore, 


wet) = S- tin (Gy E)s 
n=1 
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or equivalently 


ult tr= b> [an COS(Wpt) + by sin(wyt)| sin(—*), (7.61) 


p= 


where a, and 6, are arbitrary constants, and w,, is given in (7.60). In 
writing this down, the constant 6, in (7.57) has been absorbed into the 
Qn and by. 


Satisfying the Initial Conditions 


u(x,0) = g(a): We need 
_ _ (NTe 
2d, ig sin(“*) S90): (7.62) 
From (7.31), this means that 
Dae _ (NTX 
tn = al g(x) sin(“*) ae, (7.63) 


uzt(x,0) = h(x): From (7.61), it is required that 


yen by, sin( *) = =r): (7.64) 


Letting B, = wyb,, then the above equation takes the form 
= NTx 
Ss" By sin(“**) =h(z). (7.65) 
n=1 


This is the same problem we had in Section 7.3.5, except that the 
coefficient is being denoted as Bn instead of by. So, from (7.25), 


= 2f h(a) sin(“"*) de. 


Since b, = By/w,y, the conclusion is that 


L 
z a) de. (7.66) 


bn = — h(a) sin(* 
7.5.1 » Examples 


Example 1: Suppose that c= 1, L = 2, g(x) = 3sin(72), and h(x) = 
In this case, from (7.60), w, = na/2. The resulting general solution 
(7.61) is 


1) = > fan cos (% 1) + by sin (F0)] si n( 2). 


n=1 
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Solution 


Solution 
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Figure 7.9. Solution of the wave equation in Example 1. Shown is the solution 


surface as well as the solution profiles at specific time values. 


To satisfy the initial condition, since h(x) = 0 then, from (7.66), 
the b,,’s are all zero. As for the a,’s, note that g(x) is one of the 
sine functions in the series. Namely, it is the one when n = 2. This 
enables us to avoid the integral in (7.63). To satisfy (7.62) we simply 
take a2 = 3, and all the other b,,’s are zero. Therefore, the solution 


u(x,t) = 3cos(rt) sin(7a). (7.67) 


This solution is shown in Figure 7.9, both as time slices and as 
the solution surface for 0 < t < 37, where T = 2 is the period of 


oscillation. Hf 


Example 2: Suppose that in the previous example, the initial conditions 


are g(x) = 0 and 


h(a) =3sin(>) 4sin(=") + 5 sin(272). 


This consists of the sum of three of the sine functions in (7.65): 
n= 1,n = 3, and n = 4. To satisfy (7.65) we take By = 3, 
Bs = —4, By = 5, and all the other B,’s are zero. With this, 
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by = 3/w _ 6/7, b3 = —4/ws = —8/(37), ba _ 5/w4 = 5/(2r). 
Also, since g(x) = 0, then from (7.63), all the a,,’s are zero. The 
resulting solution is 


(e4) 6. (=) . (“) 8, (==) . (=) 
=> 1n 1n in 1n | — 
ENFSELE GENS Oe OS Be he D 


5 
+ —sin(2zt) sin(27z). 
20 


7.5.2 » Natural Modes and Standing Waves 


The curves shown in the lower plot in Figure 7.9 resemble what you see for 
time lapse photographs of a vibrating string. There is a reason for this, 
which is that the wave equation can be used to model the vibrational 
motion of an elastic string. To pursue this a bit further, we found that 
the solution of the wave equation problem consists of the superposition 
of functions of the form 


Un(&, t) = [an cos(Wpt) + bp sin(wnt)| sin(“*), (7.68) 
where ie 


The expression in the square brackets is a periodic function of t, with 
period 27/w,. In this context, sin(nax/L) is called a natural mode for 
the problem, having natural frequency wp. The resulting solution in (7.68) 
corresponds to what is called a standing wave. So, the curves shown in 
the lower plot in Figure 7.9 are plots of a standing wave in the case of 
when n = 2. It is also possible to have traveling wave solutions, similar 
to waves on a lake or ocean. If you want to learn about traveling waves, 
you might look at Strauss [2007] or Holmes [2019]. 


Exercises 


1. You are to find the solution of the wave equation problem for the 
following initial conditions. Assume that LZ = 1 and c = 4. Note that 
you should be able to answer this question without using integration. 


a) g(x) = sin(37x), and h(x) = 0 


b) g(x) = 0, and h(x) = —2 sin(872) 

c) g(x) = —sin(rax) + 4sin(372z), and h(x) = —3sin(572) 
d) g(x) = 5sin(77x), and h(x) = 2sin(87xz) + 3sin(1272) 
e) g(x) = 2sin(27x) cos(7x), and h(x) = —2 sin(872) 

f) g(x) = 3cos(2ra — F), and h(a) = —3cos(7r2) sin(272) 


2. Find the general solution of the following. 
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a) Ure = Ut, for 0 < x < 1, with the boundary conditions u(0,t) = 0 
and ti, (1, 0) = 0; 

b) 4uzx = ut, for 0 < x < 1, with the boundary conditions u,(0, t) = 0 
and u(1,t) = 0. 

C) Ure = 4uz, for 0 < x < 1, with the boundary conditions u(0,t) = 
w(t) and vn(0.t) = ug): 

d) Ure = Uretuz, for 0 < x < 1, with the boundary conditions u(0,t) = 
0 and u(1,t) = 0. This is an example of what is called a damped 
wave equation. 


3. Solve 


ax? OF’ ee 
where u(0,t) = 0, u(1,t) = 0, u(x, 0) = 0, and w(2,0) = x(1— 2). 


O7u = Ou { 0<2<l, 
or 


7.6 » Inhomogeneous Boundary Conditions 


Solving the diffusion and wave equations using separation of variables 
required the boundary conditions to be homogeneous. We now consider 
how to find the solution when the boundary conditions are inhomoge- 
neous, and have the form 


u(0,t) =a, (7.70) 
and 

u(L,t) = 8B, (7.71) 
where a and § are constants. The method used to find the solution is to 
write it as 


u(x,t) = w(x) + v(2,¢), 
where we pick w(x) so it satisfies the given boundary conditions. In other 
words, so that w(0) = a and w(L) = 8. Pretty much any smooth function 
can be used, but it makes things easier if w comes from the steady state 
equation. What this entails is explained below. 


7.6.1 » Steady State Solution 


To find the steady state solution you assume that u(x,t) = w(x). This 
is required to satisfy the PDE and the boundary conditions. Assuming 
we are solving the diffusion equation (7.9), then we are looking for the 
function w(x) that satisfies 
d2w 
— ~=0, for 0<27< LJ, 


where, from (7.70) and (7.71), w(0) = a and w(L) = 6. The resulting 


solution is 
B-a 


L 


w(2) =at nes 
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7.6.2 « Transformed Problem 


Now that we know the steady state solution, we write the solution of the 
original diffusion problem as 


B- 


8 + 0(0,1). (7.72) 


u(z,t) =a+t 


Since Ure = Vrr and uz = v4, then from the diffusion equation (7.9) we 
have that 


Dae ~ OE 0<t. siete) 


At x = 0, from (7.72), v(0,t) = u(0,t) — a = 0. This also happens at the 
other endpoint. So, the boundary conditions are 


a2u Ov for { O0<a<L, 


v(0,t) =0, (7.74) 
and 
u(L,t) = 0. (7.75) 


Finally, if the initial condition is u(x,0) = g(x), then the resulting initial 
condition for v is 


B- 


v(x, 0) = g(x) —a— On, for 0 aE, (7.76) 

The above problem for u(x,t) has the same form as the one for u(z,t), 
as given in (7.9)-(7.12), except for a slightly different looking initial condi- 
tion. Consequently, we can use the solution as given in (7.23) and (7.25) 
if we make the appropriate adjustments. In particular, 


Cae Ss" bern sin(“*), 


n=l 
where e 
i a (a(2) -o- _ n) sin“) ad, (7.77) 
and 
m= —-P(T) 


7.6.3 » Summary 


We have shown that the solution of 


O2u Ou ie 


dx? Ot’ Oues, 
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where u(0,t) = a, u(L,t) = 6, and u(x, 0) = g(x), is 


_ B-a _ Nat 2 (NUL 
u(z,t)=at Z + S~ tne sin(“), (7.78) 


n=1 


where b,, is given in (7.77). 


Example: Find the solution of 


0<2<5, 


402u = O,u, for cee 


where u(0,t) = 3, u(5,t) = 2, and u(z,0) = 0. 


Answer: In this problem D = 4, LD = 5, a = 3, and 6 = 2. So, from 
CFT) 


bn = =f 342) sin(™" \de = -— [3 - 2(--1)"]. 


Therefore, from (7.78), the solution of the diffusion problem is 


x ad) NTx 
ulet = 3 [3 — 2(-1)"] ernt sin(“T*), 
5 d nt 5 
where Ayn = ae) |_| 


7.6.4 » Wave Equation 


The method works, without change, on the wave equation. The only 
complication is, as it usually is with the wave equation, differentiability. 
To explain, if the boundary conditions are u(0,t) = a and u(L,t) = B, 
and the initial conditions are u(x,0) = g(x) and u(x,0) = h(x), then it 
is required that 


and 
gL)=8, h(L)=0,  g"(L)=0. 


These are called compatibility conditions. If they are satisfied, and g’ (x) 
and h’(x) are continuous, then the solution has the differentiability re- 
quited to satisfy the wave equation. 
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Exercises 


1. You are to find the solution of the diffusion equation 4u;, = uz for the 
given boundary and initial conditions. Assume that L = 1. 
a) u(0,t) = 1, u(1,t) = —1, and u(x, 0) =0. 
b) u(0, t) = 2, u(1,t) = —5, and u(z, 0) = 2. 
c) u(0,t) = —4, u(1,t) =1, and u(#,0) =z. 
2. Find the steady state solution of the following problems. 
a) Ure = Ut, for 0 < x < 2, with the boundary conditions u(0,t) = 1 
and u,(2,t) = —1. 
b) 4uzx = ut, for 0 < x < 4, with the boundary conditions uz(0,t) = 2 
and u(4,t) = 1. 
c) (14+ ther = uw, for 0 < x < 1, with the boundary conditions 
u(0,t) = —1 and u(1, t) = 2. 
d) Ure = uzt+u, for 0 < x < 3, with the boundary conditions u(0,t) = 1 
and u(3,t) = 2. 


€) Ure —Ux = Ut, for 0 < x < 2, with the boundary conditions u(0,t) = 
—1 and u(2,t) = 1. 


3. Solve 
Oru _ Ou 0<24< 2, 
Ox? Ot’ 0<t, 
where u(0,t) = 1, uz(2,¢) = —1, and u(a,0) = 0. 
4. Solve 
O0<a<l, 
(14+ t)d2u= Ou, for { 0<t, 


where u(0,¢) = —1, u(1,t) = 2, and u(x, 0) = 0. 


5. Solve 
Pu = Pu = 0<a<l, 
Ox2 Ot?’ 0 <t, 
where u(0,¢) = 1, u(1,t) = -1, u(z,0) = 1 — 22 — 7sin(387z), and 
uz(z,0) = 0. 


7.7 « Inhomogeneous PDEs 


It is common in applications to have a PDE that is not homogeneous. To 
explain how to solve such a problem, suppose the PDE is 


Ou du 0<a<L, 
Dra = +p(x,t), for { Gee. (7.79) 
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where p(z,t) is a given smooth function of x and t. It is assumed the 
boundary conditions are homogeneous, and so, 


u(0,t) =0, (7.80) 


and 
a EE) = 30): (7.81) 


Sine Series Expansions 


The general solution when p = 0, which is given in (7.23), consists of 
the superposition of functions containing sin(naz/L). The solution for 
nonzero p can also be expanded in this way. Specifically, we can write 


Ut = Ss" Wn(t) sin(“"*), for 0<a< JL, (7.82) 
n=1 


where the w,(t)’s are determined from the PDE. The expansion in (7.82) 
is guaranteed from the Sine Convergence Theorem (page 204) because uw is 
a smooth function and it satisfies the homogeneous boundary conditions 
(7.80) and (7.81). 

We will also expand the forcing function p is a sine series, and write 


= _ (RTE 
plat) = droll sin(“**), for 0< 2 <UL, (7.83) 
where 
@=2f (x,t) sin(“™*) a (7.84) 
Pn ara ; plz,t)s 7 Lz. : 


Because p(z,t) is known, the p,(t)’s are known. Note that it is not 
assumed that p = 0 at the endpoints, which is why the interval in (7.83) 
isO<a<Landnot0<2< UL. 

Solving the PDE 
Assuming the series for u can be differentiated term-by-term, we get that 


tigen = =p (mE) walt) sin(“"*) and uz= Ym sin(“**). 


Introducing these into (7.79), as well as using (7.83), we have that 


oy [D(F) ‘watt + w(t) + pd) sin(“**) =0. (7.85) 


n=1 
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For this to hold, the term in the square bracket must be zero. The proof 
of this uses the integration formula (7.30), in exactly the same way it was 
used to find the coefficients of the sine series. The conclusion is that 


nT \ 2 
D(=*) walt) + wh(t) + Pall) = 0, 
or equivalently, 
Wh + KknWn = —Pn; (7.86) 
where 
nT \ 2 
m= DT) 


This is a first-order linear differential equation for w,, which can be solved 
using an integrating factor. The integrating factor in this case is, from 
(2.18), w = e*". So, from (2.21), we get the general solution of (7.86) is 


Ue ert / POs un(0)] (7.87) 


Satisfying the Initial Condition 


To solve the problem it remains to satisfy the initial condition 
u(e,0)=g(x), for 0 a-< Bb, (7.88) 


From (7.25), and since b, = w,(0), it is required that 


7.7.1 » Summary 


To summarize our findings, the solution of the inhomogeneous diffusion 
problem (7.79)-(7.81), which satisfies the initial condition (7.88), is 


u(x,t) = Sao sin(“"*), (7.89) 
n=1 


where 


walt =~ hn | - [ Dn(s)e*"*ds + un(0) . (7.90) 


DAt) = 2 [ pte.0 sin(“™*) dx, (7.91) 


and ky, = D(na/L)?. 


7.7 


.7. Inhomogeneous PDEs 225 


Example 


Suppose the problem to solve is 


Ou Ou 0<a¢<1, 
4552 Stas + 3sin(2t) sin(7x), for { 0<t, (7.92) 
where 
u(0,t) = 0, 7.93) 
u(1,t) = 0, 7.94) 
and 
“eo 0. “tr ew 1 (7.95) 


In this problem, D = 4 and L = 1. The first step is to find the p,’s. From 
(7.91), we want 


3sin(2t) sin(7x) = S> pn(t) sin(n7z). 
n=1 


So, pi(t) = 3sin 2¢ and all the other p,’s are zero. Also, since g(x) = 0 
then wp(0) = 0, for all n This leaves the integral in (7.90), and so 


t t 
: pi(s)e™*ds = : 3sin(2s)e*!*ds 
0 0 


2+ Ky e%* sin(2t) — 2e*1 cos(2t) 


=3 
Ki +4 


Since K, = 4n?, then 


3 é 
w(t) = a+ an) | cos(2t) — 2n? sin(2t) — ot ; 
Therefore, the solution of the diffusion problem is 


| cos(2t) — 2n? sin(2t) — ean sin(rz). 


3 
nat) = Xi + 4x4) 


7.7.2 » A Very Useful Observation 


As you might have noticed, the problem was solved without using separa- 
tion of variables. Instead we assumed that the solution can be expanded 
in a sine series, as expressed in (7.82). For this to work it is essential that 
the functions sin(naa/L) satisfy the boundary conditions, which they do 
for this problem. By using this sine series expansion, the problem reduces 
to solving a relatively simple ODE for the coefficients of the series. This 
approach can be used on other PDEs and examples of how this is done 
are given in Exercises 3 and 4. In fact, this idea is the basis for what is 
called the Galerkin method for computing the solution of a PDE. 
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Exercises 


1. You are to find the solution of the diffusion equation (7.79), where 
u(0,t) = 0, u(1,t) = 0, u(a,0) = 0, and p(z, t) is given below. Assume 
that D=4 and L=1. 


a) p(x,t) = —4cos(t) sin(572). 
b) p(x, t) = e~*' sin(37z). 
ep ty) 1 


2. There is a simpler way to solve an inhomogeneous PDE when the 
forcing function does not dependent on t. In this problem assume that 
p(x, t) = x. 

a) Find the steady state solution of (7.79), that satisfies (7.80) and 
(7.81). 

b) Letting u(x,t) = w(x) + v(z,t), where w(x) is the steady state 
solution you found in part (a), find the PDE and boundary condi- 
tions satisfied by u(x,t). Also, if u(a,0) = g(x), then what is the 
resulting initial condition for u(x,t)? 

c) Assuming g(x) = 0, find u(x,t), and from this determine the solu- 
tion of the original diffusion problem. 


3. This exercise considers how to use a sine series to solve 


Ou Ou 
Beant A f 
an. OL +5u, for { 


0<4<2, 
0<t, 


where u(0,t) = 0, u(2,t) = 0, and u(z,0) = x. This is going to be 
done using the assumption in (7.82), which for this problem is 


[o-e) 
ted) = Dd, wall sin(“*), tor Oa <2. 
ae 


a) Assuming u(x,t) is smooth, explain why the Sine Series Conver- 
gence Theorem guarantees that the above series converges to u(z, t). 

b) Substitute the series into the PDE and rewrite the result so it re- 
sembles (7.85). From this determine the differential equation w,(t) 
satisfies. 

c) Find the general solution for w,(t), and from this write down the 
general solution for u(z, t). 

d) Use the general solution to satisfy the initial condition, and from 
this determine the solution of the problem. 


4. Solve 
Ou Ou f { 0<24 <3, 


(l+ as = op: Ged 
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where u(0,t) = 0, u(3,t) = 0, and u(x,0) = 1. Find the solution using 
the procedure outlined in Exercise 3 (with the appropriate modifica- 
tions). 

7.8 » Laplace’s Equation 


We are going to consider how to solve the equation 
V7u=0, (7.96) 


where V? is called the Laplacian, or the Laplacian operator. The 
formula for V? depends on the coordinate system you are using. In the 
case of Cartesian coordinates, 


O° 0? 
2 _ —— pane! 
— Ox? as Oy?’ 
in which case (7.96) is simply 


Later we will consider polar coordinates, and the respective formula for 
V? will be given at that time. 

It should not be a surprise that (7.96) is known as Laplace’s equa- 
tion. It plays a fundamental role in applied mathematics. If you look 
through a junior or senior level textbook in complex variables, fluid dy- 
namics, electromagnetism, heat transfer, etc, it will appear often. As 
an example, heat conduction is governed by the diffusion equation uz = 
DV?u. So, if you want to determine the steady-state temperature distri- 
bution, then you must solve (7.96). 

Our goal is to find the function u(x, y) that satisfies Laplace’s equation 
for (x,y) in a region, as illustrated in Figure 7.10, along with a boundary 
condition u = f on the boundary of the region. To keep things simple we 
will only consider simple shapes, and that means rectangular and circular. 
In both cases, the method of separation of variables is used to find the 
solution. 


Figure 7.10. The solution u(x, y) is to satisfy Laplace’s equation in a given 
region in the x,y-plane, and also satisfy u= f on the boundary of the region. 
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The symbol V? appearing in Laplace’s equation comes from vector 
calculus. Namely, using the gradient V and the dot product, one writes 


VW =HVev. 


In Cartesian coordinates the gradient is V = (2, £); and from this you 


get that V? = o - -. This can also be used to derive the formula for 
V? is other coordinate systems, such as polar coordinates. 


7.8.1 » Rectangular Domain 


The problem to solve is 


0<2 <a, 


(7.98) 
where the boundary conditions are shown in Figure 7.11. So, uw = 0 when 
x = 0, when x = a, and when y = 0. Along the top, where y = 8, 
c= fia). 

The steps used in carrying out the separation of variables method 
are very similar to what was done earlier. We will first find the general 
solution of the PDE that satisfies the homogeneous boundary conditions. 
We will then use that solution to satisfy the inhomogeneous boundary 
condition (which is on the upper side of the rectangle). 


Separation of Variables Assumption 


Assuming 
u(x, y) = X(x)¥ (y), (7.99) 


and then substituting this into Laplace’s equation gives us 


X"(x)__ Y"(y) 
Xey Yay (7.100) 


u= f(z) 


Figure 7.11. Rectangular domain used when solving Laplace’s equation and 
the corresponding boundary conditions. 
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Since the left-hand-side is only a function of x, and the right-hand-side is 
only a function of y, we can conclude that there is a constant A so that 


X" (x) = \X(z), (7.101) 


and 
Y"(y) =—-AY(y). (7.102) 


As explained earlier, the separated solution (7.99) is required to satisfy 
the homogeneous boundary conditions shown in Figure 7.11. 


Finding X(x) and 
The equation to solve is 
X"(2) = AX(2). (7.103) 
Since u = 0 when x = 0 and x = a, then it is required that 
X(0)=0 and X(a)=0. (7.104) 


This is essentially the same problem we had when solving the diffusion 
and wave equations, and the general solution is 


Lose sin(“*), (7.105) 
a 
and 
2 
a -(“) (7.106) 
a 
for n = 1, 2, 3,.... Also, c, is an arbitrary constant. 
Finding Y (y) 


From (7.102), we now need to solve 
Y"(y) =—An¥ (y) ; 
where Y(0) = 0. The general solution of this ODE is 
YS A,e"™s? + Bye rule. 
To have Y,,(0) = 0 we need B, = —Ay. Consequently, 


Y, = An (er™/2 _ eels) 
= 2A,sinh(n7y/a). (7.107) 
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The General Solution 


The resulting general solution, that satisfies the PDE and homogeneous 
boundary conditions, is, therefore, 


(oe) 


u(z,y) = > Xn(z)¥a(y), 
n=1 
or equivalently 
= Sef RN 2 fF TICE 
= sinh( —* oe) F 7.108 
u(x, y) ou sinh( ; ) sin( ‘ ) ( ) 


where the c,’s are arbitrary constants. In writing this down, the constant 
2A, in (7.107) has been absorbed into the c,, in (7.105). 


Satisfying the Inhomogeneous Boundary Condition 


To have u(x, b) = f(a), we need 
= . fnmby . (nme 
Do ensintl -T) sin(“"*) = f(g) (7.109) 
This can be written as 
Yn sin(“*) = f(a), 
n=1 c 


where b,, = cpsinh(n7b/a). According to the Sine Convergence Theorem 
(page 204), the 6,,’s that satisfy the above equation are 


= =f f(x) sin(“") ae. 


From this we conclude that 


n= cakenabJo) in F(x} sin(“*)ar. (7.110) 


With this value for c,, u(z,y) given in (7.108) is the solution of the 
problem. 


Example 1: Find the solution of 


0<a<l, 


where u(x, 1) = 8sin(57a) and u = 0 on the other three sides of the 
square (see Figure 7.11). 
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Answer: In this problem a = 6 = 1, and f(x) = 8sin(57z). From 
(7.109), we need 


8sin(572) = cpSinh(n7) sin(n72). 


n=l 


So, cssinh(57) = 8, and the other c,’s are zero. Therefore, the 


solution is 
_ gsinh(57y) 


one) sinh(57) 


The resulting solution is shown in Figure 7.12. Hf 


sin(572). 


Solution 
o 


-8 
1 — 0 
0B 
: a 06 0.4 
eee ag 
x-axis a1 y-axis 


Figure 7.12. Solution of Laplace’s equation derived in Example 1. 


7.8.2 » Circular Domain 


We now solve Laplace’s equation when the domain is the circular region 
x? +y? < a’, as illustrated in Figure 7.13. It makes it easier in this 
case to use polar coordinates and take x = rcos@, y = rsin@. Using the 
standard change of coordinate formulas, one finds that 


oO 10 #1 @ 


—_ 
¥ Gy poe pe OR 


Therefore, the problem we are solving is 


O<r<a, 


pea (7.111) 


1 1 
Urr + —Ur + use = 0, for 
r r 
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where the boundary condition is 


til =F (0): (7.112) 


As will be seen below, this problem is easily solved using separation of 
variables. 

Using polar coordinates makes solving the problem easier, but it re- 
quires some comment. First, (7.111) is singular when r = 0. This always 
happens when using polar coordinates. To prevent the singular nature of 
the equation from interfering with us solving the problem, it is assumed 
that the solution is bounded. The second comment is that the positive 
x-axis corresponds to 6 = 0 and to 6 = 27. The solution u and its deriva- 
tive ug must be continuous in the circular domain, and this means we 
must require that 


Ul oo = Ul paon and U6|o—o = i (7.113) 


In the vernacular of the subject, these are called periodic boundary con- 
ditions. Also, note that these boundary conditions are homogeneous be- 
cause u = 0 satisfies both of them. Finally, if (7.113) hold then u, is also 
continuous in the domain. 


Separation of Variables Assumption 


Assuming 
u = R(r)0(8), (7.114) 


and then substituting this into Laplace’s equation (7.111) gives us 


gp (7.115) 


re B(r) 
R(r) O(4) 


R(r) 


Since the left-hand-side is only a function of r, and the right-hand-side is 
only a function of 8, we can conclude that there is a constant so that 


r?R"(r) +rR'(r) = AR(r), (7.116) 


Figure 7.13. Circular domain and corresponding boundary condition. 
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and 


@"(0) = —rO (0). (7.117) 


From (7.113) we also must have that 
@(0)=O(27) and 0/(0)=O'(2r). (7.118) 


Finding 0(0) and 
As usual, the first problem to solve is the one involving the homogeneous 


boundary conditions, which means solving (7.117) and (7.118). 


\ = 0: In this case (7.117) is 0” = 0, and so @ = A+ BO, where A and 
B are constants. To satisfy (7.118) it must be that B = 0, and so 
the solution is Og = Ag. 


\ #0: Assuming © = e, we get the characteristic equation r? = —A. 
Skipping the two real roots case we take \ > 0 , giving us the general 
solution 


© = Acos(@VX) + Bsin(@V)). 


To satisfy (7.118) one finds that cos(27VA) = 1. This means that 
nvr = 2n, 40, 67,.... In other words, 


An =n", for n=1,2,3,..., (7.119) 


and 
O, = A, cos(n@) + By, sin(né). (7.120) 
Finding R(r) 


\ =0: In this case (7.116) is r?R” + rR! = 0. This is an Euler equation, 
and how to solve it was explained in Section 3.11. One finds that 
R= A+Blnr, where A and B are constants. To have a bounded 
solution we require B = 0, and this means the solution is Ro = Ao. 


A=n*: Now (7.116) is 
r?R" + rR! =n?7R. 


This is also an Euler equation, and the general solution is R, = 
Ayr” + Bnr—”. Because the solution is bounded we require B, = 0. 


The General Solution 


The general solution of Laplace’s equation that is bounded and satisfies 
(7.113) is 


u= S- R(r)On(9), 
n=0 
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or equivalently 
= se + Ba [an cos(n) + bp sin(n§)]. (7.121) 


The coefficients in this formula are written in a form similar to what was 

used earlier for a sine and cosine series. So, for example, we have written 
_7 i 

Roo = Ao Ao = 540 


Satisfying the Boundary Condition 


To have u = f(@) when r = a, we need 
5 + yen [an cos(n@) + bn sin(nd)| = f(A). (7.122) 


The a,’s and b,’s are determined in the same way as for a sine and cosine 
series. For example, to determine a7 you multiply the above equation by 
cos(70), integrate for 0 < @ < 27, and use orthogonality conditions such 
as given in (7.30) and (7.39). The resulting formulas obtained in this way 
are 


1 20 
i ak f (0) cos(n6)dd, 
and 
i 
i, = antl ” 66 ) sin(n@)dé. 


Solution 
° 


x-axis y-axis 


Figure 7.14. Solution of Laplace’s equation derived in Example 2. 
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Exercises 


Example 2: Find the solution of 


V2u=0, for a7?+y’? <1, 


where u = 3sin(40) for x? + y? =1. 


Answer: In this problem a = 1 and f(@) = 3sin(40). From (7.122), 
we need 


1 ~ 
3sin(40) = 500 + d [ (an cos(nO) + by sin(né)]. 
So, b4 = 3, and the other coefficients are zero. Therefore, the solu- 
tion is 
u = 3r4sin(40). 


The resulting solution is shown in Figure 7.14. 


Exercises 


1 


You are to find the solution of the problem shown in Figure 7.11. 
Assume that a = 1 and b = 2. Note that you should be able to answer 
this question without using integration. 
a) f(x) = 5sin(272) 

b) f(z) = —3sin(1272) 
c) f(x) = sin(ra) — 7sin(8rz) 
d) f(x) = —3sin(472x) — sin(77x) + 6 sin(2072) 


. You are to find the solution of the problem shown in Figure 7.13. 


Assume that a = 2. Note that you should be able to answer this 
question without using integration. 

a) f(@) = 4cos(36) 

b) f(@) = 1 — 3sin(156) 

c) f(@) = sin(@) + 3cos(50) 

d) f(@) = 4 — 2sin(56) — 4sin(90) + 8 cos(146) 


. The problem concerns solving the problem shown in Figure 7.15. 


a) Write down the differential equation and boundary conditions for 
this problem. 

b) Find the general solution. This should satisfy Laplace’s equation as 
well as the homogeneous boundary conditions. 

c) Use the inhomogeneous boundary condition to find the formula for 
the coefficient in your general solution. 

d) If g(y) = 7sin(37y), then what is the solution? 
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u=g(y) 


uv 


Figure 7.15. Problem solved in Exercise 3. 


e) If g(y) = —2sin(27y) + 8sin(7zy), then what is the solution? 


4. The problem concerns solving the problem in the quarter circle shown 
in Figure 7.16. 

a) In polar coordinates, write down the differential equation and bound- 
ary conditions for this problem. 

b) Find the general solution. This should satisfy Laplace’s equation 
as well as the homogeneous boundary conditions. It should not be 
required to satisfy the conditions in (7.113), as those only apply 
when you have a domain with 0 < 6 < 27. 

c) If f(@) = —3sin(46), then what is the solution? 

d) If f(@) = 9sin(20) — 5sin(14@), then what is the solution? 

5. Setting \ = —K?, where k > 0, what is the general solution of (7.117)? 
Show that to satisfy the boundary conditions (7.118) that the solution 
is identically zero. 

6. Suppose that instead of using 0 < 0 < 27, one were to use —7 <0 < 7. 
How are the periodic boundary conditions (7.113) changed? 


u=0 2 £ 


Figure 7.16. Problem solved in Exercise 4. 


Appendix A 
Matrix Algebra: Summary 


The following is a brief summary of the rules of matrix and vector algebra 
in two dimensions. 


A.1 = Addition: x+y and A+B 


General: 


Examples: 
1 —3\_ /-2 Ro 29 1 O0\ f2 -2 
ata} eo es en ae ae 
A.2 = Scalar Multiplication: ax and aA 


Scalar means a number (real or complex). 


General: 


“= Gen (s) 2 adele aan (e aa) 
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A.3 = Equality: x = y and A=B 


@ = (*) means that +r =u, y=v 
y v 


(: eG \ means that a=e,b=f,c=g,d=h 


General: 


Examples: note that I is defined on page 89 


i) =0O means that a=0,b=0 


é at means that a=1,b=0,c=0,d=1 


A.4 = Matrix-Vector Multiplication: Ax and aAx+y 


General: 
ax + by 
cx + dy 


0)- 
(8 20-0) 
6.90)-0-)-0-0) 

A.5 = Differentiation: x’ and (a/f(t))’ 


General: oe 7 
dt Ga) = ia) 


Examples: 


d (t+B\  (1+3¢? 
dt\ sint ]) \ cost 


Appendix B 


Answers 
Chapter 1 
Section 1.2, pg 4 
2a) r= — 2g) none 3c) r= 1/3, c= 
2b) r= 1/3 2h) r=0 3d) r=1,c=-1 
2c) none 2i) none 3e) r = —2/5,c = —-7 
2d) r =0,-4 2j) none 3f) r=-4,c=3 
2e) r = —3,1/2 3a) r=-2,c=1 
2h = 2 3b) r=—-l1,c=-1 
Chapter 2 
Section 2.1, pg 12 
la) y = (9t+c)-3, and y =0 2e) y(t) =In (1/2 mut) 
1b) y = +(2e-* +c)“ 1/?, and y = 0 of) y(t) = 24+ V442t 
1c) y= —1/(cost +c), and y = 0 2g) y(t) = 2 arctan (1+ t) 
ld) y=34/t?/2+¢ Bt 
le) y = —In(4t? + 2t +0) 2h) y(t) = 7 oe y 
1f) y= —1nBn(t +1) +¢ 2i) y(t) =4 n(e-?* +e? 1) +t 
1g) y = —4 In(2e?" +c) 2j) y(t) = In (t f2 +1/2Vt 4+ +4) 
th) y = — 45 nféIn(2) +] 3a) 4(") = — Fay 
li) y = 4[-14(6t+0)-¥/7], y = -} 3c) h(r) = —2 + 4e7/8 
1j) y= —2-1/(t+0) and y =— 3d) h(x) =6 (24632) * 
Ik) y=3-2/(t+c) andy =8 3e) z(r) = 6 (1+6 In((1+e")/2))~ 
11) y = tan(t/3 + c) 3f) w(r) =1/2 mi (1/87* + 1) 
1m) y = In[tanh(t?/2 + c)], y=0 3 6 6 +1) 
In) y = In(ce* — 1) ae ( 
; 3h) r (6) = see 
lo) y=+vceh —1 4 
= 1 a) y—In(l+y)=t — 
2a) y () = 5 Fepea 4b) fat a te 
2c) y(t) =4+7t , 4c) yt+mn(lt+y) =t+5+In(6) 
2d) y (t)=(1+n(4+e’)-In(5))" 4d) p—eP =r +2-e°% 
5c) y = acosh(£) + h — acosh(4) 
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Section 2.2, pg 18 


la) 


y(t) =ce*! 
y (t) =—t/2— 1/4 + ee 
y(t) = -2t— 14+ e*/4¢ 
y(t) =e’ -1l+e ‘ce 
20 t—cos(4 t)+e 
y(t) = ee 
y(t) = 
y =—3t+e* a se >%ds+ce 
_ 1 pt ses/? 
y=e (4 aaa ds +c) 
y(t) = —4+ 3e! 
= 8. Bien 
y(t) = 6t— 34 
y(t) =2e%/® 
y(t) =e? +4-2e2 
_ =t+10 
y(t) = 


Section 2.3, pg 28 


me 
Ac) 


meh days 
either 40 or 39 BC 
50 In(10) min 


5(1 


= oye 


5b) 104(1 — e“*) kg 


6c) 


324000 
11 [1 


— (33) ""] ibs 

—20 + 120e-*/? m/s 
—In6)m 

—(176/c)(1 — e~2¢*/11) fps 


Section 2.4, pg 39 
us=unstable; as=asymptotically stable 


la) as 
1b) us 
1c) as 
1d) us 
2a) y = 1, us; y = —2, as 
2b) y = —1, us; y = 3, as 
2c) y= +1, us; y = 0, as 
2d) y = £2, as; y = 0, us 
Chapter 3 
Section 3.5, pg 52 
la) —7,1 
ib) =22 
1c) de? V3, de? 
1d) 1 + 2e?/3, 1 + 2e? 


us 


Appendix B. Answers 


2f) y= —(2/3)e“/6 fre" /Sds 
3a) q(z) =2-—30e-7? 
e 42 
3b) p(x) = -24 + $ - 85 
3c) w(r) = e?7 — e7/? 
3d) 2(7) =—7/4— i¢ 4 °5 
—x+14 
3f) h(z) = Bz4l 
4a) Yp = —3, yn = ce?" 
Ab) yp = 3te*, yn = ce 
Ac) Yp = —3 + 1/13 e?*, yx = ce’/? 
ta) yp = [ieds,qn ace 
5a) —2 
5b) —1 
7b) w(t) = ton 
d) 792 + 968e~9/1! f¢ 
8e) —22 fps 
9e) m/e- cle 
lla) P= pave 8z + 27),z=e 
12a) P= — 95092 = 
13d) 5 5 nt In(oa/30) min 
14c) k= (11/4 — p74) 15 


15b) 120 242/39) min 


In(4/3) 
In(31/28 
15¢) 1207G1=5) min 
2e) y = —In2, as 


2f) y = —2, as; y = 2, us 
2g) y = 0, as; y = In3, us 
2j) y = 0, as; y = —2, as; y= -1, 


2i) y= 0, us; y= 1, as 
2j) y = —2, us; y = 3, as 


10c) 750 

te) MV3— NEVE + VE 
1f) —e!?,0 

3a) y(t) = cy e727? + coe? 
3b) y (t) = cy e72* + cg et/? 
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3c) y(t) = cr + cge73* Ad) y(t) = 4— 5et/5 
3d) y (t) = cy e*/? + cg e'/? 4e) y = 3exp(—(1/3) V3t) 
3e) y=c1 + cot 4f) y = 5exp(—(1/2)t) 
3f) y (t) = c, 8! + co e8 't 4g) y(t) = —e* —e*t 
3g) y (t) = c, e*/? + eg e*/t 4h) y(t) = —1/3 sin (3t) — cos (3t) 
3h) y = cz sin (t/2) + cg cos (t/2) 4i) y = —e~* sin (2t) — e~' cos (2t) 
3i) y (t) = cz e’ sin (t) + cg e* cos (t) 4j) y = 2e*/? cos (t/3) 
3j) y = e7*(cz sin (2t)+cz cos (2t)) 6a) (1+t)° 
4a) y(t) = —1/3e7*+1/3e7* 6b) cos (t? + 61) 
Ab) y(t) = —8e2 —2e~?¢ 6c) t+2 
Ac) y(t) = —4/3 + 1/3e73¢ 8b) 4, 4, 0 
Section 3.8, pg 61 
1a) y(®) = ~e" 
__ —n? sin(mt)—37 cos(mt)+2 sin(xt) 
1b) y= nwt +52 +4 
le) y(#) = —5t? — 81 — @ 
1d) y (t) = 3 sin(@#) 15 cos(2 t) 1/6 et 
le) y(t) = —4¢° + 30t? — 178¢ + 535 
1f) y (t) = 4 cos? t) 33 sin(2 t) 4 
1g) y(t) = (5t — 2) e°/5 
1h) y(t) = (3t — 1) cos(3t) /3 — (5t + 2) sin(3t) /5 
li) y@=P4+4/5t+3 
1j) y(t) = 1/10 + 3/13 e° 
1k) y(t) = -#? —t? —3/4t44.4/3t 
11) y(t) = —e* + 38" 
e** cog t)t 

a rs rae 21 sin(t+7) 
Be as 
lo) y(t) =5 +55 7 
lp) y (t) = —2 sin (2t) — 1/4 cos (2t) 
2a) y(t) =e3 eg +e-7'c, — et 

20: " 
2b) y= cye72t coe pee sin(at) Sn costnt)-tein(ré) 
2c) y(t) =ebco te°*c, — 5t? — 8t- 2 

ene £ f sin(2 15 cof2 
2d) y(t) = + Bebe, + cp — SHED _ Uecod?t) 
2e) y (t) =e ee +e? *c, — 4t8 + 30¢? — 178¢ + 535 
2f) y (t) = et/4 eg et/2¢, 4 cos(? t) 33 a 4 
2g) y (é) = sin (2t) ce +.cos(2t) cy + FP 
2h) y (t) = coe? e086! Be 1) cod $4) (Gt+2) sin(Se) 
2i) y (t) =sin (2t) eco + cos (2t)e'c) +t? +4/5t+ 38 
2j) y(t) =e‘ sin (3t) cg +e! cos (3t) cy + 1/10 + 3/13 e 
2k) y(t) = 1/3e8 te; + cg —t? — #8 — 3/444 +.4/3t 
—2t 

21) y(t) =e tee + e?/3te, — ef + 35 — ; 
2m) y (t) = e* sin(t) cp + e# cos(t) c, — —ekB# 
2n) y (t) . Stes “i etc; 15 cot 7) 21 aa 
20) y(t) =e"%e, + 5 +e-*ee 4 cont?) Ssin(2t) 
2p) y (t) = e7*/4c, + cg — 2 sin (2t) — 1/4 cos (21) 
3a) y(t) = —e~7* + 4e' — 6t-— 3 
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3b) y(t) = —1 + 2cos(2t) + 22 
3c) y(t) = —e’ — sin(t) + cos(t) + 1 
e3t 2 ; 4 
OS Se ip 7, : eo: 
3e) y(t) = 2G" et 
3f) y(t) =e2 +(1—-t)e"2-1 
3g) y(t) = sin n(3t) + cos(3t) + cos(3t) t 
3h) y(t) =e* sin(2t) + e~’ cos(2t) +e" 
3i) y(t) = 2e2 sin(s ) — 2sin(t) — cos(t) 
5a) y(t) = —2/5e" +b ebte 
5b) y (t) a e72/3t¢ | —34 cose? sin(z t) 
5c) y(t) = 2/3t — 2/9 +e-3te 
5d) y(t) = -3t —15-1/6e* + e/¢ 
5e) y(t) = — cos(2t) t — — — 2sin(2t) t — ee) +ete 
Bf) y(t) =—2te* — 28 _ 1 + efte 
5g) y(t) = —1/10e~* cos (t) + 3/10 sin (t) e~* + e 2/3 *¢ 
5h) y(t) = —1/4 cos(2t+5) +1/4 sin(2t +5) +e? *c 


Section 3.9, pg 65 


° Yp = —2e77* + Qet/? — Fe?" 
1b) yp =3+4+(- d cos ) +3 sin (t)) ef 


1c) Yp = —e-7* foln (1 + s)0?* ds +e fon (1 + s)e-*ds 
1d) yp = 3t+ ae = e oe" e858ds—1+e¢-3! 
le) yp = —2 In(¢ +1) + ef rae" ds 
Lf) Yp = —e7? f sin(s? + 1) eds +e? f' sin(s? +1) e~#ds 
: en-2t 
2a) y(t) = Ssh 4 ay, 
2b) y(t) = —e! sin(t \+ e' cos(t) + Yp 
e2t 2e¢ 
2o) y(t) = 2 + 28 + up 
20) ult) = 1+ yy 
a) yt) ta shay, 
3a) 2t(-—t+e' — 1) 
3b) 1/2 (t— 1) e?* +.1/24t/2 
8c).4P? 
4b) 1/2 sin (t) Vt 


Section 3.10, pg 76 


la) w =3,R=V2,p=7/4 4e) 1 

Si ee oles Sat 5b) u= 24/3 cos (2\/3t — 32) 

1c) wo = 1, R = 2/V3, 9 = 20/3 5f) Vin /18 
1d) wo = 2, R = 4/2, 9 = —30/4 ) 3./2.cos (10t — 7) 
2a) R =2,p=7/2 6e) 5(2 + v3) 3/40 
ea aaa 9b) w= —ghV 1de~** sin(2V/15t) 
2c) R = 2V2,p = 1/4 9d) + ec 1_ (32_Arctan(—4))) 
) R=2V2,y~ = —30/4 a4 v15\ 2 V15 
)R=2 = 2/3 10d) u = V2e7** cos(t — 1/4) 

f) R95 oon 14b) u(t) = 3/4 sin (16t) t 


4b) u = 4. cos(8t — 7) 15b) 


a (t) _ 5 sn t)t 
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Section 3.11, pg 81 


la) y (x) = cy 2? + cg x7 In(z) 

1b) y (x) = cz x? sin (In (x)) + cg x3 cos (In (2)) 

1c) y(t) = Se +00 VE 

1d) y (2) zsin (1/2 /3In (x )) + ¢2 Vw cos (1/273 In ( x)) 

le) y(x) = cy x7 sin (3 In(x)) + cg 2? os In (x)) 

If) y(z) = S + a5 2b) y (x) = -1/42* -—24+1/44+2? 

1g) y (a) = ce In(x) + 1 2c) y(x) =2-—2x2+(x+1)In(z) 

th) y(x) = cea? +c1 2d) y (x) ue —3/2 me )+3/4 

li) y(x) = At ceart? 2e) y (x = ae 

2a) y (x) = —x%e + xe* es r(@ ) 
Chapter 4 

O. tp, 1 ie 

2 i) A=| ta alt ii) ay = ln [=| | 
a)a=1,b=2,c=-3,m=1r2=-3 b)a=4,6=0,c=1,n = hi, 
rp = —5i; c)a=4,b=3,c=-1,m=1/4,r2=-1 d)a=1,b=4,c=0, 
ry = 0, Tg = —4 
Section 4.3, pg 94 

1 a) indep, b) dep, c) dep, d) indep 

2a) 3,2 2b) 5,-1 3a) 2+ 2i 3b) -1+2% 


Section 4.5, pg 101 
c_le~3* + ¢_ 27 
—1/3c_Le~3* +1/2c_2 7! 
c_le*t/? 4 ¢ 2et/? 
=e tert? £969 /? | 


| 


cl+c20! 
—2¢_14+3c¢_20* 
—c_2e* 


5c_1sin(3t) 


+ 5c_2cos(3t) 


2c_1sin(4t) 
c_1 (sin (4t) — cos (4t)) 


— sin(3t) + 3cos(3t)) 


| 


+ c_2(—cos(3t) — 3sin(3t)) 
+ 10c_2cos(4t) 
+ 5c_2(cos (4t) + sin (4t)) 


| 


c_1 e/? sin (t) + c_2 e*/? cos (t) 
1 (—2e!/? sin (t) + 4e'/? cos (t)) 
Bie 2 (—2e'/? cos (t) — 4e*/? sin (#)) 
Qc. ae sin(3t) + 2c_2e~* cos(3t) 


' sin (3t) — e~? cos (3¢)) 
— cos (3t) + ee sin ( a 


, 
| 
a 
of: 
af 
| 
ws 


li) | cd(e7 
c_2(e 
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2a) {c1= 8,c2=2},b){c_1 =9/4,c2=7/4}, 
ce) {cel = 3, c_2 =7/5} ,d) {c_1 =—1, ¢_2 = —4} ,e) {c_.1 =4,c.2 =-1}, 
Prel=—qree=4) ot el=3,c2= sl Wier T4e2 =4) , 


da) | —2c_le*+c_2e?*-c8et 
clet+c2et+e3e% 
cleb+3c2e!42c3e't 
4b) c_2 et 


ceet+c3e 
2c_le'—c2e?? 


Ac) Sete 
Tolei+4c2e7t*+c8e 
cle 
4d) 2c_Lev* +26 3e Ve 


—c.8 (V5 +1) e~¥* + ¢_2 ev (5 — 1) 

5b) yi = 5+4+5e-35, yo =—5e 7m +5 
Section 4.6, pg 109 
4a) 142i, b) 142i, c) -2+4i, d) -2+4i 


Section 4.7, pg 115 
us=unstable; as=asymptotically stable; ns=neutrally stable 
si=sink; so=source; ssi=spiral sink; sso=spiral source; sa=saddle; c=center 


la) us, sa le) as, si li) ns, c 3d) us, sso 5d) us 
1b) as, si 1f) us, sso 3a) us, sa 5a) us 5e) ns 
1c) us, so 1g) as, ssi 3b) as, si 5b) as 5f) as 
1d) us, so 1h) ns, ¢ 3c) as, ssi 5c) us 


Section 4.8, pg 117 
t e- 5 V3 sin vat 
1b) f =e72 cos( 3+) 2 5 (4) 


- $3 sin( Bt 
sg) 4 Tivol 89 
2 3 


1c) u=e72 cos( 


2e) uy = —sin(t) + sin(2t), ue = —2sin(t) — sin(2t) 


Chapter 5 

Section 5.1, pg 124 
2a) (u,v) = (1/2, 0), (1/3, 1/4) 2f) (s,c) = (1,1) 
2c) (u, v) 7 (1/4, 4) 2h) (x,y) = (0, 2), (0,—1), (2,0) 
2d) (S,P) = (1,1), (0,0), (2, 0) 2i) (x,y) = (0,0), (0,6), (1,3), (4, 0) 
2e) (S,I) = (5,0), (1, 2) 2j) (u,v) = (0,0) 


) 
Section 5.2, pg 135 
) (u,v) = (1,-1), us, sa 
1b) (u,v) = (0,0), us, sa 
1c) (x, y) = (0,0), as, si; (a, y) = (2/3, 4/9), us, sa 


1d) (S, £) = (0, Eo), us, sa 
le) (u,v) = (1/2,0), us, sa; (1/3, 1/4), as, si 
1f) (u,v) = (1/4, 4), as, si 
1g) (r, 8) = (—2,—2), us, sa; (r, 8) = (1,1), as, ssi 
th) (x,y) = (0,0), id 
li) (x,y) = (0, 1), us, sso 
1j) (u,v) = (1, 1), us, sso 
1k) (x,y) = (0,0), us, sa; (x,y) = (c/d, a/b), i 
11) (S, P) = (0,0) us, sa; (S, P) = (2,0), us, sa; ae P)= 
1m) ( 1) =( ,0), as, si; ($,1) = (2, -1/2), us, Sa 
In) (r,s) = (1,—3), as, si; (r,s) = (—1,—2), us, sa 
3a) (,y) = (a,4°), us; (0,4) = (—a, a3), a8 
3b) (7, y) = (a, cos(a)), us 
4) a) B, b) C, a) A,d) D 
7) b) N < b/a; c) N > b/a 
Section 5.3, pg 146 
la) H =v? + 3e7 /2 — 3u 
1b) H = v?/24+ 3 In(1 + 5u?) 
1d) H = 5v?/2+ Pu? /2 + 3u1° 
ld) H = v?/24+4/3 (uw? a) 
5) d) ,/3/2; e) —1; f) V3 [I (3 + u?)(1 — u?)]-/2du 
6) d) V2(1 ci em ee In(2 eR a) 
f) V2 en l(1 — e71)? — 1 — e)9] 7 du 
7) e) d=—a, H = bv? /2 — cu? /2 + auv 
Chapter 6 
Section 6.1, pg 157 
= 3243 
la) —(s—5) 1k) 2 Gane 
1b) (44+33)/s? 11) 32 
eee DD ae 
id ieee a) 6 Grae 
s+2 (s—7)? 2b) 6 s*—49 
le) 8573 ) 
1f) (9s? —6s +2)/s? ac) 2 19) 
1g) 4s-14+858-7+88 2d) 10 s+2 
th) Yea ((s+2)?4+25) 
Li as case 3a) dopo Uk EFT 
1j) 3 ie eae 3b) Lk=0 ar/(s a k) 
s—1 s2+4 3c) Se ak Fine pe2 


Section 6.2, pg 160 
la) 2/3 sin (3t) 


1b) 3te~* + 5et 
1c) 1/5e’ —1/5e7*# 


~* cos (2 t) 


le) 1/4e?£ 4 7/ 
) 


det 


1f) 1/3e7¢ (6 cos (3t) — 5 sin (3t)) 


1g) —cos(4t) + cos(3t) 
1h) cosh(4t) — cosh(¢) 
li) sin (2t) — sin (31) 
1j) te’ + t?e7 + £303 
1k) sin(t) + sinh(t) 

11) 7cos(t) — 3t 


(1,1), as, ssi 
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1m) —2e'+1+e” 
In) e?'—e~* (V3 sin(V/3t) + cos(V3t)) 
2a) 1 — cos(3t) 


Section 6.3, pg 163 


la) -1+ (s—4)Y 

1b) 4+ (28+7)Y 

Ic) PY +5Y42s4+1 
1d) (s?+3s—2)Y +2s 
le) (4s? +2s)Y+8s-—2 


Section 6.4, pg 168 


la) 1+e—*/? 
b) -1/2e* + e#/8 
Q 1/3e—7* —1/3e8 
1d) 2te* 
le) 4 4—5et/5 
1f) —2 sin (t/2) — cos (t/2) 
1g) —e' cos (t) 
1h) eon t) 
2a) 4e¢ —e-2* 64-3 


4a) Joln( ee e ots? dr+e-3t 


Appendix B. Answers 


2b) 1—e7* (4t +1) 
2c) —2e° + 1+ e7! 


a) 1/2e' —1/2 cos(t) —1/2 sin (t) 
b) 1/2tsin (t) 

c) cost(sint — 2 cost) +1+e7% 
2d) —1/2 sin (t) + 1/2 sinh (¢) 

e) 1/2t? + cos (t) —1 

f) —cos(t) +1 


2b) —1+ cos (2t) +20? 
sin (t) + cos (t) — 2 


2e) 1— 1/2e' cos (2t) — 1/2e~* 
3a) fon (1 +37) Beers de 


0 
3b) a val ae (3t— ee 

1 t+27 1 t/2—7 
3c) —5 Soe I+ pio ae OP 
3d) 5 Josi n(1+77)e~*7 sin (2t — 27) dr 


4b) cos (3t) + 4 gon er dr 


—2t4+27 


Ac) afoot + 2/5! - 5 ae 


Ad) e~ 


Section 6.5, pg 171 


-6s 


dr +e a Io° 
‘sin (2t) + 5 df, sin( al + 77)e~7 sin (ot — 2r)dr 


t et/2- wee 
14+7 


la) 2c) H(t —1) — H(t — 2) + H(t — 3) 
1b) e Se 35 2d) 2—t+2t? in 7/60 
1c) Sera a8 2e) Hit = 5)t 
14) ee 2f) H(t—6) (5 cos (t — 6) + sin (t — 6)) 
s 1 i e* 
nee re 
3s __e 4ste 1 
i) Sy se 
1g) 1=2e 207% 2073s dc) aera 
1f) Berane trae 4d) Mewea2e* 
2a) H(t — 3)e?—* cos(—9 + 3) 5c) (1s 
2b) —1/2 H(t — 2) (t — 2) (t— 4) 
6a) 1+ H(t—-1)+ H(t—2)+ H(t-3)+ H(t—4) + 
6b) 1— H(t— 2) + H(t—4) — H(t-—6)+ H(t—8)+--- 
6c) 1—1/2H(t—1) + 3/8 H(t — 2) SHOTS) 5 HG) 1... 
6d) 1+t/2-1/16t+&- 2h 4+4--- 
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Section 6.6, pg 175 


la) —(s—5)~', Re(s) >5 2b) 2-22" 
1b) 8s~3, Re(s) > 0 ge) —Gstie4(ote"* 
lc) oY 18’ Re(s) > 0 2d) e7?* ° 
1d) —1_,, Re(s) > —2 cane 
3) 2e) : STI 
2a) s2 of) acs 


Section 6.7, pg 181 
e4* + 3/4 H(t — 1) (1—e-4**4) 
1b) (- 1+ et/2-2) H(4 _ t) _ et/2-2 
1c) 9) H(t a 3)e —t+3 _ et 
1d) —1/2 H(t — 2) + 1/2 (1 — H(2—t))e**® + e4*-* (A(1 = 4) — 1) 
le) 1/10 H(t — 5) (—5 + 3e72 +10 4 2e3t-15) 
( 


f) 3/2 H(t — 4) (sin ( — 4))” — 3/2 H(t — 2) (sin (t — 2))” 
1g) 3/4 H(t — 1) (-1+e***) 
1h) —2 H(t — 2) sin (t — 2) + H(t — 3) sin(t — 3) 
2) Q(t) = —DH(t — 2)e~ 30+ 25 + 950e- 55 +50 
3) b) P = 100e”* — 500e**-? (H(t — 1) +e“? H(t — 2) +e 4 H(t — 3) + ---) 
b) v = 35H(t—10)e74+3 — 40+ 40e74, 
) « = 1160 — 40t — 160e~4 + 140H(t — 10) (1 —e~4t2 
5) b) T = —200H(t — 120) (1 — e~*(—9)) 4. 200H (¢ — 180) (1 — e~ #189) — 
280 e—*# + 350, c) about 230 minutes 


ie] 


) 
) 
4) 
Cc 
) 


Section 6.8, pg 186 


18e°" +2/5¢7% 2d) —2e' cos(t) + e’ sin(t) +t+ 2 

la) e’ sin(t) + 3e! cos(t) — 4t — 3 

Aetenedl ee 

7/4et/? +9/4e-%/? 3a) aS 
1b / / ) EB oe eo 

7/2et/? — 9/2e—*/? s 1/4 

5/2e7* +3/2e4# 3b) avi 
Ic 1 os 

—5/2e7* + 3/2e4* ea 0 

Be: | 30) Gap = ee | 

5t 
eke e : ga od 
4e2t 3d) 22545 

le) oe 1 s—1 

=a nee de) yy =5 +5e7% yo = Se +5 


—et cos (2) — 8e¢ sin (21) yo = —236 e150 + 36 e750 + 200 


1f) te! sin (2t) + 4e* cos (2t) | 5c) y= —118e7 too Ve 720-80 + 200, 
aor 8e 3t4 ‘| 5c) Y= 8e7 30 + 2e~ TH, yo = 


—4e—50 + 4e7 100 


4e7# 8e es : ‘ 
3 + 4 6c) i= sin(t) ES sin) 
5h 30? 7 2 sin) sin) 
) | ei? — at oo 7 


e3 sin( Yt 
2) | a even | 7d) u=e7 tcon( 8) eS) 
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Chapter 7 


Section 7.2, pg 194 


la) w(0) = Sagar 
1b) u(a) = Sys 
1c) u(x) = oa 
1d) u(x) = ae 


) 
(x) = —2e-" + a? — 2274 2e71 
(x) = =s= +e" _ gin(der) 

3a) Un = bp sin[ 3 (2n — 1)a], with An = —[%(2n — 1)]? 

3b) uo = bo, with Ao = 0; and un = b, cos("*x), with A, = —(24)? 

3c) u = be~**/? sin(ra/4), with \ = +4/4 — (1/2)? 

3d) un = bre * sin(nrz), with \, = 14+ (nz)? 

3e) up = bo, Ap = 0; Un = Gy sin(27nx) + by, cos(2rnx), with A, = 4n?n? 


Section 7.3, pg 200 
la) ~Ae- ton" ' sin (5 7 x) 
1b) 6 e863 *t sin (11 72) 
1c) e~ 3" sin (wx) + 8-48" sin (47 x) — 1007 147*"t sin (7 7 x) 
1d) —e~27*"t sin (37x) + 7e~1%27"* sin (8 1 x) + 2e7875*"¢ sin (15 1 x) 
le) 2e727""t sin (3.r x) + 2e-3™¢ sin (12) 
5) (-14(—D)™)e7""*"* sin(1/2n 22) 


2a) onal a 
2b) es, 4 (—1+2 cy"  sin(1/2n7 2) 

=r t cin Tx oo n(— —1)” enh tt sin nh x 
2c) 4/3 e aa /2 ) pues 2 (-—1+(-1) oH (1/2 ) 
2d) rai (2 cos(1/2.nn) 2 1) en tt sin (1/2n7 2) 
De) at (tt +2 1) ent sin (1/2n7 2) 


3) Dart 30 (—1)"e7”"*"* sin(1/3.n 72) 
) pias (2 cos(1/4n7)—2 cos(3/4n r))e7 8/20 tt sin(1/2n7 2) 


n=1 nr 
Ba) 22 bane *! sin(kinx), kn = m(2n — 1)/2 
5b) Vin=t bne “48 cos(Kn at), ky = 7(2n—1)/2 
c) yy Dn e-kn (t+t? /2) sin(kn2), ee 
bd) ¥ 4 One —kntte™ “sin(knz), kn =n 
on = phe —k3tt+e7 £51) sin(k32) _ 12e(- k2gt+e—*-1) sit(Kys2) 
7a) (1+2)F" =F, 7G'-—tG =AG 
7b) r?R” + rR’ = AR, 8” = -—d’O 
7c) (e*F’)! = X\(1+27)F, G’ = AG 
d) 2" 4+32Z' =\Z,Y" +9Y =AY 
Te) (F'/F)? = , (G’/G)? =e*-d 


Or 


Section 7.4, pg 212 
4a) ye a 4 (—1)" sin(1/2n 7 x) 


nt 
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[o-e) nt 1)"e?-1) sin(1/2n72 
4b) dine 2 ((-1) * a / ) 


n sin ees 
a anaalibnss 


n ead 
4 i ner) 


4d) a 


4(—1)"+2 ae nr )+2) sin( 2 nee ) 


nt 


e 
4f) ay os 1)"—8 eee. i) 2.) —_ (1/2nna) 


NAT 


D 
ah) Soe, (-ece eG) ae) ) 


Ai) yroe_, Ceod 2) Peon 38) sof 98) 
pee ( scuttle ote EL 4 2) sine) 


n=1 aa 

6a) 1+ S~> 8cos(1/2nma) /(n?n?) 
n=1 
n odd 


—1)"e?—1) cos NT2Z 
OEY eR an pie pale «cosets bei 
6c) cos(7x) 


az a 8cos (1/2n7 x) /(n?7?) 
aaa 


6e) 3 3 +Dma ( es 
spade yo ee) 
6g) $4 25nce, OTE 200) nd) 

3 a ye, ( 2(nm sin( 2% )4 } e042 1)”) co “)) 
ee (=2sin( ™ )+2 sin( 247 )) cos "5 ) 
pi) ee ee, Cae sie Seen) 
8a) 1/3 + (4 Ci" cos(n'n a) 


nn 


Oa) 577, 2 Cay" sin(n' 2) 


n=1 nt 


Section 7.5, pg 218 
aa sin(372) 
1b) —;g= sin(32zt) sin(872) 
lc) —cos (47t) sin(ax) +4 cos (127 t) sin (37x). 30m 
1d) B 66s (28 rt) in (772) sin(32 nt}sin(8 2) sin(48 7 t) sin(12 7 x) 
le) cos (12 7 t) sin (37 x) + cos (47 #) sin (7 x) 
1f) 30 0s (8 Tr t) sin (2 a x) sin(36 xt) sin(9 7 x) mays 
2a) = (an cos(Knt) + bn sin(kn Ay sin(kin®), kn = (2n —1)n/2 
2b) \7P-, (@n cos(2knt) + by sin(2knt)) cos(knx), ky = (2n—1)r/2 


3 sin(20 7 t) sin(5 7 x) 


167 
sin(32 7 t) sin(8 7 x) 


16a 
3 sin(20 7 t) sin(5 7 x) 
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2c) at bt + O°, (an cos(nt) + bn sin(nmt)) (An cos(2nrx) + By sin(2n72)) 
2d) e~ 4/2 7°, (an COS(Wnt) + bn Sin(wnt)) sin(n@zx)), wy = V4n?x? — 1/2 
3) ye 2 ie) seer) sin(n 7 x) 


n=1 nin 


Section 7.6, pg 222 
lay tH Dee 8 (14(—1)")e7 4? *"* sin(n m2) 


n=1 nt 


Hh ABR 
1b) Si Daa 14 (=1)"e7? _ sin(n 7 x) 
ee 
je) A aS pe Sane 
2a) l—«x 
2b) —7 + 2a 
2c) -1+3e 


2d) Ae® + Be~*, where A = (2 — e~3)/(e3 — e~3), B = (e? — 2)/(e? — e~3) 
2e) A+ Be”, where A = (1+ €?)/(1—e?), B=2/(e? — 1) 

4) 14324 0%, 2 (142 (-1)") eo” ™ (412) gin (nw 2) /(n-T) 

5) 1— 22-7 cos(97t)sin (372) 


Section 7.7, pg 226 
i —4ks ee "5 *) sin(5aax 
jah; eee sa el JERE is pens MOR 


es *(-1+e!3 t-2 ©) sin(3 7 x) 


1b) =a , where k3 = 367? 


ae (-14(-1)”) ent nt sin(n 7 x) 
Ic) ond ( 
3d) De 4 


1/2 


ners 
= 2 
(s4i/4n 7 )s sin(1/2n7 2) 


nT 


Section 7.8, pg 235 
la) 5sinh(27y) sin(272)/ sinh(47) 
1b) —3sinh(127y) sin(1272)/ sinh(247) 
1c) sinh(zy) sin(7a) / sinh(27) — 7 sinh(87y) sin(872)/ sinh(167) 


sinh(47y) sin(47ax) sinh(77y) sin(772) sinh(207y) sin(2072) 
1d) 3 sinha) Sinh(1 de} + 6 sinh(0n} 
2a) $7? cos(30) 
2b) 1 — 3(r/2)' sin(158) 


2c) (r/2) sin(@) + 3(r/2)° cos(56)) 
) 4 — 2(r/2)° sin(50) — 4(r/2)° sin(90) + 8(r/2)4 cos(140) 
3d) 7sinh(372) sin(37y) / sinh(37) 
3e) —2sinh(272) sin(27y) / sinh(27) + 8 sinh(772) sin(77y)/ sinh(77) 
Ab) 7°, cnr?” sin(2n6) 
4c) —3(r/2)4 sin(48) 
4d) 9(r/2)? sin(20) — 5(r/2)*4 sin(140) 
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H(-), 169 
W(y1, y2); 46 
L£(-), 155 
6(t), 177 
det(-), 90 

V, 45, 89 

I, 90 

V7, 227 
Im(-), 49 
Re(-), 49 

g, 23, 66, 75 
i, 49 


Abel’s formula, 46 
acceleration, 2, 22, 43, 83, 
190 
advection equation, 189 
Airy’s equation, 168 
amplitude, 67 
Archimedes’ principle, 30, 77 
associated homogeneous 
equation 
first-order equation, 17 
matrix equation, 18 
second-order equation, 44, 
54, 59 
asymptotically stable, 35 
linear system, 113 
nonlinear system, 126, 127 
autonomous equation, 35, 
120 


balance law, 190 
bang-bang wave, 172 
baseball, 31 
beam equation, 6 
Bernoulli equation, 19 
Bessel equation, 66 
Beverton-Holt model, 32 
boundary conditions, 191 
diffusion equation, 195 
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periodic, 195, 232 

wave equation, 214 
boundary value problem, 190 
Brownian motion, 190 
buoyant force, 30 
BVP, 190, 215 


catenary, 13 
center, 114 
central force field, 149 
characteristic equation, 47, 
51, 190 
eigenvalues, 90 
compatibility conditions 
wave equation, 221 
complex conjugates, 94 
complex number, 49 
imaginary part, 49 
real part, 49 
convolution theorem, 162 
cosine series, 208 
convergence theorem, 208 
differentiability, 211 
critical point, 39 


damped 
critically damped, 78 
over-damped, 78 
damped wave equation, 219 
damping 
critically damped, 70 
over-damped, 70 
under-damped, 71 
weakly damped, 72, 74 
damping constant, 70 
Dead Sea scrolls, 29 
defective matrix, 97 
delta function, 177 
determinant, 46, 90, 136 
differential equation 
dependent variable, 2 
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first-order linear, 14 
first-order system, 83 
homogeneous, 3 
independent variable, 3 
linear, 3 
order, 3 
second-order linear, 43 
diffusion equation, 189 
inhomogeneous, 222 
inhomogeneous boundary 
conditions, 219 
separation of variables, 195 
steady state, 219 
discontinuous forcing 
function, 175 
distribution, 180 
drag force, 23 
on sphere, 31 
driving frequency, 73 
Dulong-Petit law of cooling, 
27 


eigenvalue, 89 
eigenvalue problem, 90 
BVP, 192 
eigenvector, 89 
independent, 92 
electrostatic force, 149 
epidemic equilibrium, 134 
epidemics, 84 
equilibrium point, 39 
Euler equation, 79 
Euler’s formula, 48 
existence and uniqueness 
theorem, 44 
exponential order, 174 


Fejér summation, 208 
floor function, 172 
flutter, 74 

forcing 
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periodic, 78 
forcing amplitude, 73 
forcing function, 43 
oscillator, 72 
Fourier sine series, 198, 202 


Galerkin method, 225 
general solution 
diffusion equation, 198 
first-order equation, 16 
linear system, 88, 95 
second-order equation, 44, 
59 
wave equation, 215, 229 
Gibbs phenomenon, 208 
gravitational acceleration 
constant, 23, 66, 119 
gravitational force, 23, 66, 
149 


half-life, 28 
half-plane of convergence, 
173 

Hamiltonian, 140, 146, 148 

Hamiltonian system, 148 

Heaviside step function, 169 
derivative, 180 

Hilbert space, 212 

homicide victim, 33 

homogeneous, 3 

Hooke’s law, 66 


identity matrix, 90 
impulse, 178 
impulse forcing, 177 
indeterminate steady state, 
130 
inhomogeneous, 3 
inhomogeneous boundary 
conditions, 219 
initial condition, 2 
diffusion equation, 195 
separation of variables, 198 
initial conditions 
second-order equation, 44 
wave equation, 214 
initial value problem, 2 
second-order equation, 44 
integral curves, 103 
integrating factor, 15, 224 
isolated steady states, 123 
IVP, 2 


Jacobian matrix, 128, 129 
joke model, 137 


jump discontinuity, 169, 173, 
203 


Kelvin-Voigt material, 117 
Kermack-McKendrick 
model, 84 


Laplace transform, 155 
convergence theorem, 174 
convolution, 162 
impulse forcing, 177 
inverse, 157 
of derivative, 161 
periodic function, 171 
solving differential 

equations, 163 
table, 158 

Laplace’s equation, 227 

periodic boundary 
conditions, 232 

libration, 143 

linear approximation, 128 

linear operator, 156 

linear system 
first-order, 84 
general solution, 88 
homogeneous, 86, 183 
inhomogeneous, 183 
second-order, 118 

linearized stability theorem, 
129 

linearly independent 
equating coefficients, 58 
functions, 45 
vector functions, 89 
vectors, 92 
Wronskian, 46 

logistic equation, 25 


mass-spring-dashpot, 6, 66 
matrix 
defective, 94 
identity, 90 
non-invertible, 90 
singular, 90 
Maxwell material , 117 
Maxwell viscoelastic 
material, 19 
measles, 120, 135 
method of undetermined 
coefficients, 55 
first-order equation, 18, 61 
Michaelis-Menten equations, 
6, 124 
mixing problems, 20 
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natural frequency, 67, 218 

natural mode, 218 

neutrally stable, 36, 113, 127 

Newton’s law of cooling, 26 

Newton’s second law, 2, 23, 
43, 66, 67, 83, 138, 
140, 149, 190 


ODE, 3 
one-sided stability, 42 
oscillator 
Duffing, 124, 147 
Morse, 147 
simple harmonic, 67, 138 
Toda, 124 
Van der Pol, 124 


partial differentiation 
notation, 189 

partial fractions, 165 

particular solution, 17 
non-uniqueness, 55 
second-order equation, 54 

PDE, 3 

pendulum, 6, 119, 142 
period, 146 

periodic forcing, 78 

periodic orbit, 151 

periodic solution, 67, 138, 

146 

phase, 67 

phase plane, 103 

phase portrait, 104, 129, 130 
table, 105 

Picard-Lindelof theorem, 12 

piecewise continuous, 173, 

202 

predator-prey equations, 124 

principle of superposition, 5 
linear system, 87 
PDEs, 198 


radioactive decay, 1, 6, 28 
Rayleigh quotient, 194, 195 
reduction of order, 47, 80 
resonance, 73 


saddle, 114, 130 

saddle point, 131, 133 

sawtooth wave, 172 

Schrédinger’s equation, 6 

separable equation, 7 

separation of variables 
for ODE, 8 
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for PDEs, 196, 214, 228, 
232 

non-uniqueness, 11 

separation constant, 196 
separatrix, 143 
simple harmonic motion, 67 
sine series, 198 

convergence theorem, 204 
sink, 114, 130, 133 
SIR model, 84, 120 
Somigliana equation, 23, 75 
source, 114, 130 
spiral sink, 114, 130, 131 
spiral source, 114, 130 
spring constant, 66 
square wave, 171 
stability theorem 


linear system, 114 

nonlinear system, 129 

single equation, 35 
standing wave, 218 
steady state, 35 

linear system, 113 

nonlinear system, 122 

PDE, 219 


Temple Scroll, 29 
term-by-term differentiation, 
211 

terminal velocity, 24, 31 

trace, 116, 136 

transfer function, 165 
systems, 186 

triangle wave, 172 
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turkey, 32, 182 


unstable, 35 
linear system, 113 
nonlinear system, 128 


variation of parameters, 19, 
62 
velocity, 2, 22, 83 
angular, 119 


wave equation, 189 
compatible boundary 
conditions, 221 
damped, 219 
weight, 23, 75, 77 
Wronskian, 63, 89 


